-- Logs begin at Thu 2022-07-28 04:39:14 UTC, end at Thu 2022-07-28 05:53:30 UTC. -- Jul 28 05:18:29.132596 dv-cinder-799871-48-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 05:18:29.141852 dv-cinder-799871-48-smb devstack@keystone.service[80302]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 05:18:29.143985 dv-cinder-799871-48-smb devstack@keystone.service[80302]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 05:18:29 2022] *** Jul 28 05:18:29.143985 dv-cinder-799871-48-smb devstack@keystone.service[80302]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 05:18:29.143985 dv-cinder-799871-48-smb devstack@keystone.service[80302]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 05:18:29.143985 dv-cinder-799871-48-smb devstack@keystone.service[80302]: nodename: dv-cinder-799871-48-smb Jul 28 05:18:29.143985 dv-cinder-799871-48-smb devstack@keystone.service[80302]: machine: x86_64 Jul 28 05:18:29.143985 dv-cinder-799871-48-smb devstack@keystone.service[80302]: clock source: unix Jul 28 05:18:29.143985 dv-cinder-799871-48-smb devstack@keystone.service[80302]: pcre jit disabled Jul 28 05:18:29.143985 dv-cinder-799871-48-smb devstack@keystone.service[80302]: detected number of CPU cores: 4 Jul 28 05:18:29.143985 dv-cinder-799871-48-smb devstack@keystone.service[80302]: current working directory: / Jul 28 05:18:29.143985 dv-cinder-799871-48-smb devstack@keystone.service[80302]: detected binary path: /usr/bin/uwsgi-core Jul 28 05:18:29.144635 dv-cinder-799871-48-smb devstack@keystone.service[80302]: your processes number limit is 47680 Jul 28 05:18:29.144635 dv-cinder-799871-48-smb devstack@keystone.service[80302]: your memory page size is 4096 bytes Jul 28 05:18:29.144635 dv-cinder-799871-48-smb devstack@keystone.service[80302]: detected max file descriptor number: 2048 Jul 28 05:18:29.144635 dv-cinder-799871-48-smb devstack@keystone.service[80302]: lock engine: pthread robust mutexes Jul 28 05:18:29.144635 dv-cinder-799871-48-smb devstack@keystone.service[80302]: thunder lock: enabled Jul 28 05:18:29.144635 dv-cinder-799871-48-smb devstack@keystone.service[80302]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 05:18:29.144635 dv-cinder-799871-48-smb devstack@keystone.service[80302]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 05:18:29.183807 dv-cinder-799871-48-smb devstack@keystone.service[80302]: Python main interpreter initialized at 0x556eaeaaa9c0 Jul 28 05:18:29.183807 dv-cinder-799871-48-smb devstack@keystone.service[80302]: python threads support enabled Jul 28 05:18:29.183807 dv-cinder-799871-48-smb devstack@keystone.service[80302]: your server socket listen backlog is limited to 100 connections Jul 28 05:18:29.184047 dv-cinder-799871-48-smb devstack@keystone.service[80302]: your mercy for graceful operations on workers is 90 seconds Jul 28 05:18:29.184149 dv-cinder-799871-48-smb devstack@keystone.service[80302]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 05:18:29.184255 dv-cinder-799871-48-smb devstack@keystone.service[80302]: *** Operational MODE: preforking *** Jul 28 05:18:29.184530 dv-cinder-799871-48-smb devstack@keystone.service[80302]: *** uWSGI is running in multiple interpreter mode *** Jul 28 05:18:29.184530 dv-cinder-799871-48-smb devstack@keystone.service[80302]: spawned uWSGI master process (pid: 80302) Jul 28 05:18:29.184726 dv-cinder-799871-48-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 05:18:29.186155 dv-cinder-799871-48-smb devstack@keystone.service[80302]: spawned uWSGI worker 1 (pid: 80315, cores: 1) Jul 28 05:18:29.186155 dv-cinder-799871-48-smb devstack@keystone.service[80302]: spawned uWSGI worker 2 (pid: 80316, cores: 1) Jul 28 05:18:29.186155 dv-cinder-799871-48-smb devstack@keystone.service[80302]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 05:18:34.775878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:18:34.775878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes Jul 28 05:18:34.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:18:34.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes Jul 28 05:18:34.803374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:18:34.803374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes Jul 28 05:18:34.803983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 05:18:34.803983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes Jul 28 05:18:34.847969 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 05:18:34.848176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 05:18:34.848362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] command line args: [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 05:18:34.848640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 05:18:34.848819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ================================================================================ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 05:18:34.849086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.849368 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_dir = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.849559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.849744 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_source = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.849924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] debug = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.850124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.850631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.850725 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.850930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.851180 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.851412 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.851590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_config_append = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.851767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.851987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_dir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.852152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.852657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.852911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.853185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.853441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.853621 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.853798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.854044 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.854295 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.854530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.854765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.854910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 05:18:34.854992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.855121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 05:18:34.855205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.855277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] command line args: [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 05:18:34.855453 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.855540 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 05:18:34.855689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ================================================================================ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 05:18:34.855775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.855940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.856024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.856183 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_dir = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.856368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.856454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.856592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_source = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.856676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] publish_errors = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.856779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] debug = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.856984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.857087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.857245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.857335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.857415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.857494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.857667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.857746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.857911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.857990 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.858143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.858292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] standard_threads = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.858423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_config_append = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.858552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.858692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.858779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.858866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_dir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.858951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.859029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.859107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_journal = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.859183 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.859249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_json = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.859249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_stderr = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.859528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.860250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_syslog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.860346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.860471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.860589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.860805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.861011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.861284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.861554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.861818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.862139 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.862252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.862409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.862591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.862676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.862904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.863055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.863135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.863371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.863503 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.863610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.863861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.863979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.864111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.864392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.864476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.864877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.864961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.865070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] publish_errors = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.865330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.865419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.865562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.865739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.865825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.865985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.866218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.866296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.866451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] standard_threads = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.866682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.866767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.866924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.867099 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.867176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.867274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_journal = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.867395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.867475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_json = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.867606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_stderr = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.867683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.867781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_syslog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.867917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.867997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 05:18:34.868173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.868252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.868417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.868495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.868676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.868756 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.868942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.869026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.869212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.869294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.869453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.869539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.869694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.869779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.869925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.870008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.870157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.870225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.870395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.870485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.870639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.870716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.870872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.870951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.871106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.871183 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.871337 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.871423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.871579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.871660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.871812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.871892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.872046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.872124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.872294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.872372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.872528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.872605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.872776 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.872856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.873000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.873078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.873256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.873342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.873490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.873574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.873723 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.873801 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.873954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.874037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.874191 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.874269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.874431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.874509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.874659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.874738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.874892 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.874959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.875121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.875198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.875557 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.875926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.876033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.876241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.876418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.876574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.876710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.876957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.877217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.877458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.877543 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.877686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.877775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.877921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.878001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.878155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.878244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.878368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.878462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.878605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.878685 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.878834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.878916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.879063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.879153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.879296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.879377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.879542 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.879631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.879772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.879849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.880012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.880148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.880233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.880309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.880465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.880565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.880749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.880836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.881021 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.881167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.881270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.881452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.881542 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.881696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.881785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.881946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.882042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.882184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.882271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.882419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.882513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.882651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.882747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.882884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.882977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.883123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.883361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.883802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.884055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.884300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.884571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.884870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.885015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.885193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.885437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.885437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.885683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.885683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.885921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.886052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.886210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.886341 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.886471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.886601 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.886729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.886851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.886995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.887140 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.887266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.887397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.887525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.887657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.887798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.887946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.888079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.888219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.888359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.888493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.888623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.888769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.888901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.889884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.890080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.890257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.890496 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.890589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.890739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.891172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.891486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.891831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.892078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.892319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.892474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.892554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.892678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.892785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.892954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.893033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.893269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.893518 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.893758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.894006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.894121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.894247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.894371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.external = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.894504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.894614 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.894766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.894924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.895005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.895169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.895255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.external = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.895409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.password = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.895503 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.895647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.token = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.895728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.895894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.895974 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.896135 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.896216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.password = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.896385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.896524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.token = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.896667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.896797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.896933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.897065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.897226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.897351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.897479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.897620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.897760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.897889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.898016 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.898144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.898271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.898441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.898580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.898580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.898830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.898958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.899085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.899220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.899358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.899485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.899619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.899753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.899882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.900019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.900155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.900283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.900409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.900535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.900662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.900800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.900926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.901053 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.901204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.901327 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.901454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.901661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.901791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.901916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.902043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.902172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.902299 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.902434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.902560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.902688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.902820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.902960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.903087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.903223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.903357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.903485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.903485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.903731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.903859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.904056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.904257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.904456 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.904609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.904739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.904866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.905013 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.905169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.905308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.905438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.905607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.905736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.905872 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.906001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.906130 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.906984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.907118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.907243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.907378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.907378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.907378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.907378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.907378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.907944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.908080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.908203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.908331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.908452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.908577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.908699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.908837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.908837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.909069 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.909177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.909353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.909477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.909614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.909740 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.909867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.909867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.910100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.910235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.910371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.910495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.910619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.910743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.910875 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.911022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.911157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.911157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.911289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.911464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.911593 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.911730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.911859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.911986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.912113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.912241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.912320 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.912403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.912478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.912550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.912623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.912696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.912768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.912848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.912922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913322 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.913990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.914142 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.914221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.914380 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.914460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.914618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.914700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.914848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.914927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.915087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.915167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.915319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.915400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.915555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.915635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.915790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.915870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.916022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.916102 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.916255 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.916334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.916489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.916569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.916739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.916819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.916972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.917050 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.917235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.917321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.917467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.917549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.917697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.917783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.917941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.918022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.918173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.918259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.918427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.918506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.918673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.918751 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.918906 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.918987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.919153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.919231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.919389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.919469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.919627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.919709 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.920048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.920130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.920130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.920334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.920568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.920797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.920991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.921072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.921273 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.921356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.921508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.921590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.921739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.921820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.921985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.922139 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.923057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.923173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.923358 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.923478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.923607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.923738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.923854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.923980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.924086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.924238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.924318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.924483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.924637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.924761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.924879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.925115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.925222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.925374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.925465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.925620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.925700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.925869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.925950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.926110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.926252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.926384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.926517 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.926647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.926730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.926884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.926957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.927033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.927251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.927709 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.927966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.928214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.928446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.928780 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.928906 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.929034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.929199 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.929341 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.929465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.929591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.929716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.929840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.929964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.930098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.930222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.930349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.930475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.930602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.930726 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.930874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.930999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.931130 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.931253 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.931380 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.931502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.931637 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.931762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.931887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.932011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.932381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.932508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.932645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.932767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.932904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.933034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.933034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.933335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.933469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.933686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.933930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.934062 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.934185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.934314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.934452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.934578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.934706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.934832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.934970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.935097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.935329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.935576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.935821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.935905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.936067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.936193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.936405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.936534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.936734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.937341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.937564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.937670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.937893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.938215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.938308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.938472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.938620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.938796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.938939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.939077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.939207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.939338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.939468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.939638 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.939785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.939916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.940045 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.940174 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.940303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.940441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.940570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.940701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.940830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.940959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.941088 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.941262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.941396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.941536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.941708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.941843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.941967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.941967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.942225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.942355 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.942483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.942635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.942835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.942987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.943246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.943452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.943657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.943837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.943972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.944118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.944249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.944379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.944509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.944638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.944767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.944906 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.945037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.945185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.945316 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.945442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.945583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.945722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.945853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.945982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.946111 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.946239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.946367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.946504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.946674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.946865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.947054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.947247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.947443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.947631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.947852 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.948058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.948058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.948352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.948483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.948612 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.948749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.948877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.949005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.949150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.949279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.949406 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.949505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.949573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.949679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.949855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.949855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.950096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.950233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.950363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.950492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.950492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.950753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.950883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.951006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.951215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.951346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.951473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.951608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.951735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.951868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.952008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.952135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.952264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.952264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.952512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.952638 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.952773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.952897 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.953023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.953176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.953371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 05:18:34.953553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.953553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.953553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.953553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.953553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.953553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.953553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 05:18:34.953553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 05:18:34.982469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:34.982758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:34.982902 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:34.990154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:34.990386 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:34.990619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:34.992096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.002673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.022605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.022851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.028100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.028288 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.077950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.087417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.130913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.131218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.137053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.137309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.200595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.200807 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.201033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.201289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.201501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.201716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.202662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.202892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.203113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.203856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.204071 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.204283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.226909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.227147 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.227371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.227597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.227821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.228043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.228257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.228639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.228873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.229096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.229347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.229560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.229771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.229984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.240019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.240496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.253377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.253607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.253832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.254056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.254276 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.254491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.254704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.254951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.255189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.255413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.255624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.255837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.256048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.256260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 05:18:35.272714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.272927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:18:35.273284 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.273487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:18:35.273757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.274018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.274273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.274526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.275295 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.275505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:18:35.275839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.276037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 05:18:35.276303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.276563 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.276822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.277074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.285155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.285384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.285775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.286238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.287732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.287991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.288288 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.288750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.293326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.298183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.298359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.298642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.298926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.299209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.299488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.299745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.300009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.300280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.300550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.300820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.301084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.302970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.303364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.303647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.303923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.304198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.304456 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.304719 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.304984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.305271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.305541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.305801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.325175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.326691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.326973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.332851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.333150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.333366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.333517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.335589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.336062 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.340131 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.340407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.342136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.343150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.343150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.345544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.345838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.346117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.346398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.346671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.346950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.347223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.347495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.350287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.350566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.354729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.355019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.355371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.355649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.355910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.356185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.356457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.356833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.368353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.368635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.372676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.373374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.373655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.376010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.376301 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.377648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.380737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.380885 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.381078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.383986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.385486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.387201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.387499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.387781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.388073 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.388361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.388651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.388782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.392541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.392833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.393114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.393427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.393707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.393988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.405571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.405853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.406118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.406412 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.410708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.410985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.411248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.411516 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.414118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.415665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.415941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.418450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.418789 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.419072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.419368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.419648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.419936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.420087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.420349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.423188 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.423462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.423757 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.424034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.424317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.431650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.431932 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.432466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.432744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.433021 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.433318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.433595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.436046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.436323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.436602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.436882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.437177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.437451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.437753 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.449492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.452485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.453889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.456208 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.456874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.458797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.460364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.460656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.460938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.461073 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.462433 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.463920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.464201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.464478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.467526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.469797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.471816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.472745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.473034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.473322 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.473411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.473612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.476241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.476530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.476807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.477077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.481746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.482034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.482325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.485202 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.485496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.485779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.489289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.489572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.489851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.490126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.490410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.490698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.490973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.491249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.491618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.491899 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.492185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.492470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.492632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 05:18:35.492736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.492906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.492998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.493204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.493589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.493871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.494153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.494422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.494694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.494959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.495230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.495501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.495771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.496042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.496295 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 05:18:35.527520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556eaeaaa9c0 pid: 80315 (default app) Jul 28 05:18:35.530867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e72e-b57b-4d00-af17-3ec56a8760c1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:35.530957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556eaeaaa9c0 pid: 80316 (default app) Jul 28 05:18:35.531159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e72e-b57b-4d00-af17-3ec56a8760c1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:35.531493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e72e-b57b-4d00-af17-3ec56a8760c1 None None] PATH_INFO: `/v3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:35.535956 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Thu Jul 28 05:18:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:18:43.753284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6980178-7aeb-431c-98c5-e30d8e742eee None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:43.753857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6980178-7aeb-431c-98c5-e30d8e742eee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:43.753857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6980178-7aeb-431c-98c5-e30d8e742eee None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:43.758082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:18:43.763108 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3726306-1521-4b52-a105-339c76ac6f77 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:43.763489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3726306-1521-4b52-a105-339c76ac6f77 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:43.763650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3726306-1521-4b52-a105-339c76ac6f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:43.834065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: INFO dbcounter [None req-c3726306-1521-4b52-a105-339c76ac6f77 None None] Registered counter for database keystone Jul 28 05:18:43.855231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG oslo_db.sqlalchemy.engines [None req-c3726306-1521-4b52-a105-339c76ac6f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:18:43.862065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writer thread running {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:18:44.036176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-c3726306-1521-4b52-a105-339c76ac6f77 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80315) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 05:18:44.036505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-c3726306-1521-4b52-a105-339c76ac6f77 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80315) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 05:18:44.091100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c3726306-1521-4b52-a105-339c76ac6f77 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:44.092708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c3726306-1521-4b52-a105-339c76ac6f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:44.215598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 28 05:18:44.371933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6980178-7aeb-431c-98c5-e30d8e742eee None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:44.442165 dv-cinder-799871-48-smb devstack@keystone.service[80316]: INFO dbcounter [None req-f6980178-7aeb-431c-98c5-e30d8e742eee None None] Registered counter for database keystone Jul 28 05:18:44.460906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG oslo_db.sqlalchemy.engines [None req-f6980178-7aeb-431c-98c5-e30d8e742eee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 05:18:44.467152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writer thread running {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 05:18:44.587822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6980178-7aeb-431c-98c5-e30d8e742eee None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:44.592115 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5608bb3-74a9-4598-a8df-d5e5842d645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:44.592768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608bb3-74a9-4598-a8df-d5e5842d645f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:44.593051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608bb3-74a9-4598-a8df-d5e5842d645f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:44.593908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5608bb3-74a9-4598-a8df-d5e5842d645f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:44.602041 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5608bb3-74a9-4598-a8df-d5e5842d645f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:44.654097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a5608bb3-74a9-4598-a8df-d5e5842d645f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 05:18:44.654385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5608bb3-74a9-4598-a8df-d5e5842d645f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:44.664836 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 05:18:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:18:44.670802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3726306-1521-4b52-a105-339c76ac6f77 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:44.686248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3726306-1521-4b52-a105-339c76ac6f77 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:44.691055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adf1bc-1b9c-46b6-88a7-d1869e298529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:44.692196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adf1bc-1b9c-46b6-88a7-d1869e298529 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:44.692445 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adf1bc-1b9c-46b6-88a7-d1869e298529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:44.692730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adf1bc-1b9c-46b6-88a7-d1869e298529 admin admin] PATH_INFO: `/v3/projects/75ff8d8e50894a1db12ad71f3510dfd6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:44.694257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adf1bc-1b9c-46b6-88a7-d1869e298529 admin admin] RBAC: Authorizing `identity:get_project(project_id=75ff8d8e50894a1db12ad71f3510dfd6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:44.745301 dv-cinder-799871-48-smb devstack@keystone.service[80315]: WARNING keystone.common.rbac_enforcer.enforcer [None req-35adf1bc-1b9c-46b6-88a7-d1869e298529 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 05:18:44.745651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adf1bc-1b9c-46b6-88a7-d1869e298529 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:44.750264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Thu Jul 28 05:18:44 2022] GET /identity/v3/projects/75ff8d8e50894a1db12ad71f3510dfd6 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:18:46.746756 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d45b-9663-442e-906d-e6f80460ea07 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:46.747276 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d45b-9663-442e-906d-e6f80460ea07 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:46.747389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d45b-9663-442e-906d-e6f80460ea07 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:46.751511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:18:46.756745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41441399-1457-4522-ab65-be1c5a66eeba None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:46.757123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41441399-1457-4522-ab65-be1c5a66eeba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:46.757339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41441399-1457-4522-ab65-be1c5a66eeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:46.777093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-41441399-1457-4522-ab65-be1c5a66eeba None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:46.778651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-41441399-1457-4522-ab65-be1c5a66eeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:46.787112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 05:18:46.809499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1d45b-9663-442e-906d-e6f80460ea07 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:46.821370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1d45b-9663-442e-906d-e6f80460ea07 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:46.825490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74da26-809f-4f56-af11-8d12b3e8e6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:46.826091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74da26-809f-4f56-af11-8d12b3e8e6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:46.826370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74da26-809f-4f56-af11-8d12b3e8e6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:46.826642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74da26-809f-4f56-af11-8d12b3e8e6e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:46.834533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74da26-809f-4f56-af11-8d12b3e8e6e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:46.836293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74da26-809f-4f56-af11-8d12b3e8e6e8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:46.845593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 05:18:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:18:46.851040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41441399-1457-4522-ab65-be1c5a66eeba None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:46.861093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41441399-1457-4522-ab65-be1c5a66eeba None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:46.865506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31b2ad-a040-4f20-99cd-9a2288dc7e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:46.866140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b2ad-a040-4f20-99cd-9a2288dc7e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:46.866425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b2ad-a040-4f20-99cd-9a2288dc7e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:46.866699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b2ad-a040-4f20-99cd-9a2288dc7e31 admin admin] PATH_INFO: `/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:46.868068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31b2ad-a040-4f20-99cd-9a2288dc7e31 admin admin] RBAC: Authorizing `identity:get_user(user_id=c8a78ca62f5c4d3896c5e2f1cd4cb186)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:46.869949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31b2ad-a040-4f20-99cd-9a2288dc7e31 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:46.871506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Thu Jul 28 05:18:46 2022] GET /identity/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:18:48.930052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f6625-dfb2-4e90-96b7-13b93a7b1392 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:48.930593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f6625-dfb2-4e90-96b7-13b93a7b1392 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:48.930593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f6625-dfb2-4e90-96b7-13b93a7b1392 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:48.932196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:18:48.938214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eec2a-885e-447f-8956-478cbaba4d41 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:48.938639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eec2a-885e-447f-8956-478cbaba4d41 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:48.938763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654eec2a-885e-447f-8956-478cbaba4d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:48.958179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-654eec2a-885e-447f-8956-478cbaba4d41 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:48.959374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-654eec2a-885e-447f-8956-478cbaba4d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:48.994436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1e34-ed38-4db3-9bce-9a639577357a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:48.994719 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1e34-ed38-4db3-9bce-9a639577357a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:48.994988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b1e34-ed38-4db3-9bce-9a639577357a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:48.996337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:18:49.001147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784718d6-7877-42ec-a028-6e60f2602cdb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:49.001439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784718d6-7877-42ec-a028-6e60f2602cdb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:49.001716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784718d6-7877-42ec-a028-6e60f2602cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:49.040202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:18:49.043790 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-784718d6-7877-42ec-a028-6e60f2602cdb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80316) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 05:18:49.044209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-784718d6-7877-42ec-a028-6e60f2602cdb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80316) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 05:18:49.063757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654eec2a-885e-447f-8956-478cbaba4d41 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:49.086596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:49.090368 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-784718d6-7877-42ec-a028-6e60f2602cdb None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:49.091964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-784718d6-7877-42ec-a028-6e60f2602cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:49.168501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654eec2a-885e-447f-8956-478cbaba4d41 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:49.196525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:18:49.202797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc81083-ff59-4b3f-86ed-882f68beae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:49.203436 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81083-ff59-4b3f-86ed-882f68beae0c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:49.203718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81083-ff59-4b3f-86ed-882f68beae0c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:49.203989 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81083-ff59-4b3f-86ed-882f68beae0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:49.214856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc81083-ff59-4b3f-86ed-882f68beae0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:18:49.220647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784718d6-7877-42ec-a028-6e60f2602cdb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6bc81083-ff59-4b3f-86ed-882f68beae0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:18:49.224054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:18:49.225210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:18:49.226224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:18:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:18:49.230885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc81083-ff59-4b3f-86ed-882f68beae0c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:49.312075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:49.322871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784718d6-7877-42ec-a028-6e60f2602cdb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:49.325230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:49.329645 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc81083-ff59-4b3f-86ed-882f68beae0c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:49.360802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0594d-372a-4125-95b7-2a9b742b3664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:49.361709 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0594d-372a-4125-95b7-2a9b742b3664 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:49.361999 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0594d-372a-4125-95b7-2a9b742b3664 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:49.362275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0594d-372a-4125-95b7-2a9b742b3664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:49.364825 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492c42a-40dd-4206-ad05-1bdab73dab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:49.365501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c42a-40dd-4206-ad05-1bdab73dab3f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:49.365791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c42a-40dd-4206-ad05-1bdab73dab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:49.366074 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c42a-40dd-4206-ad05-1bdab73dab3f None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:49.366804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492c42a-40dd-4206-ad05-1bdab73dab3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:18:49.367110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492c42a-40dd-4206-ad05-1bdab73dab3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:49.368522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492c42a-40dd-4206-ad05-1bdab73dab3f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:49.380522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:18:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:18:49.386046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492c42a-40dd-4206-ad05-1bdab73dab3f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:49.429596 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0594d-372a-4125-95b7-2a9b742b3664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:49.431126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0594d-372a-4125-95b7-2a9b742b3664 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:49.485104 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492c42a-40dd-4206-ad05-1bdab73dab3f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:49.531651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:18:49.537648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0594d-372a-4125-95b7-2a9b742b3664 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:49.540846 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:49.625219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35f91-7d76-4f6b-9147-e3b1cc59c781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:49.625870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35f91-7d76-4f6b-9147-e3b1cc59c781 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:49.626144 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35f91-7d76-4f6b-9147-e3b1cc59c781 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:49.626414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35f91-7d76-4f6b-9147-e3b1cc59c781 None admin] PATH_INFO: `/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:49.627579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f35f91-7d76-4f6b-9147-e3b1cc59c781 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a78ca62f5c4d3896c5e2f1cd4cb186)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:49.629033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f35f91-7d76-4f6b-9147-e3b1cc59c781 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:49.630659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:18:49 2022] GET /identity/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186 => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:18:49.636089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35f91-7d76-4f6b-9147-e3b1cc59c781 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:49.642610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0594d-372a-4125-95b7-2a9b742b3664 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:49.650699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:49.676161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24843a-0730-4bd3-9da2-38fdd9a7b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:49.677117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24843a-0730-4bd3-9da2-38fdd9a7b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:49.677455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24843a-0730-4bd3-9da2-38fdd9a7b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:49.677714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24843a-0730-4bd3-9da2-38fdd9a7b1f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:49.696848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24843a-0730-4bd3-9da2-38fdd9a7b1f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:49.698343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24843a-0730-4bd3-9da2-38fdd9a7b1f0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7a24843a-0730-4bd3-9da2-38fdd9a7b1f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:18:49.716137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:18:49.716994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:18:49.717844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:18:49.717844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:18:49.717844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:18:49.717844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:18:49.717844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:18:49.723877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24843a-0730-4bd3-9da2-38fdd9a7b1f0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:49.738154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35f91-7d76-4f6b-9147-e3b1cc59c781 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:49.771315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971335-0807-4bfb-9f27-35b31132d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:49.771962 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971335-0807-4bfb-9f27-35b31132d147 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:49.772243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971335-0807-4bfb-9f27-35b31132d147 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:49.772519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971335-0807-4bfb-9f27-35b31132d147 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:49.773713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c971335-0807-4bfb-9f27-35b31132d147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:49.775171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c971335-0807-4bfb-9f27-35b31132d147 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:49.776756 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:18:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:18:49.780073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:49.783126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971335-0807-4bfb-9f27-35b31132d147 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:49.824490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24843a-0730-4bd3-9da2-38fdd9a7b1f0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:49.859297 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3999e-bd4f-457b-a5a1-9ad5462a3de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:49.859925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3999e-bd4f-457b-a5a1-9ad5462a3de7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:49.860204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3999e-bd4f-457b-a5a1-9ad5462a3de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:49.860479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3999e-bd4f-457b-a5a1-9ad5462a3de7 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:49.861219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3999e-bd4f-457b-a5a1-9ad5462a3de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:18:49.861538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3999e-bd4f-457b-a5a1-9ad5462a3de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:49.862962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3999e-bd4f-457b-a5a1-9ad5462a3de7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:49.865577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:49.880089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:18:49.883852 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971335-0807-4bfb-9f27-35b31132d147 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:49.922185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f13c35-7dc7-4b8d-95a8-d31ecabb72eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:49.922818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f13c35-7dc7-4b8d-95a8-d31ecabb72eb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:49.923284 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f13c35-7dc7-4b8d-95a8-d31ecabb72eb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:49.923563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f13c35-7dc7-4b8d-95a8-d31ecabb72eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:49.924381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f13c35-7dc7-4b8d-95a8-d31ecabb72eb None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.domain.id=default, user.id=c8a78ca62f5c4d3896c5e2f1cd4cb186) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:18:49.924691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f13c35-7dc7-4b8d-95a8-d31ecabb72eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:49.926210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f13c35-7dc7-4b8d-95a8-d31ecabb72eb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:49.934157 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 05:18:49 2022] GET /identity/v3/role_assignments?user.id=c8a78ca62f5c4d3896c5e2f1cd4cb186&scope.domain.id=default&role.id=57a86ff4c9de433399662eebf6893065 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:18:52.017694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a765164-951b-485a-aa72-5645e09f2938 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:52.018225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a765164-951b-485a-aa72-5645e09f2938 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:52.018225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a765164-951b-485a-aa72-5645e09f2938 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:52.019690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:18:52.025013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc83c7-3fc0-4ca5-ba76-b259cdcea3a3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:52.025466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc83c7-3fc0-4ca5-ba76-b259cdcea3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:52.025671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc83c7-3fc0-4ca5-ba76-b259cdcea3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:52.050217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-62dc83c7-3fc0-4ca5-ba76-b259cdcea3a3 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:52.051426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-62dc83c7-3fc0-4ca5-ba76-b259cdcea3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:52.143053 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:18:52.177999 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a765164-951b-485a-aa72-5645e09f2938 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:52.231688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4bae4-408e-4bc0-92ed-109b943fd8a4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:52.232019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4bae4-408e-4bc0-92ed-109b943fd8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:52.232251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4bae4-408e-4bc0-92ed-109b943fd8a4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:52.234512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:18:52.239447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a1aca-6e7a-4aa8-9079-8ff064e7b646 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:52.239735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a1aca-6e7a-4aa8-9079-8ff064e7b646 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:52.240014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a1aca-6e7a-4aa8-9079-8ff064e7b646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:52.281509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2d9a1aca-6e7a-4aa8-9079-8ff064e7b646 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:52.282685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2d9a1aca-6e7a-4aa8-9079-8ff064e7b646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:52.389341 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a765164-951b-485a-aa72-5645e09f2938 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:52.433504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:52.450214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 14/25] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 28 05:18:52.464667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a4470-080c-4305-8578-b7fb4e69dda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:52.465394 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a4470-080c-4305-8578-b7fb4e69dda8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:52.465681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a4470-080c-4305-8578-b7fb4e69dda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:52.465954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a4470-080c-4305-8578-b7fb4e69dda8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:52.481654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a1aca-6e7a-4aa8-9079-8ff064e7b646 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:52.491767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a4470-080c-4305-8578-b7fb4e69dda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:18:52.492922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-516a4470-080c-4305-8578-b7fb4e69dda8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:18:52.510785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:18:52.511721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:18:52.512501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:18:52.516312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 12/26] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:18:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:18:52.518427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a4470-080c-4305-8578-b7fb4e69dda8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:52.732625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a1aca-6e7a-4aa8-9079-8ff064e7b646 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:52.798612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30271178-4f0e-44ae-af0b-8741ff876487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:52.799274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271178-4f0e-44ae-af0b-8741ff876487 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:52.799559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271178-4f0e-44ae-af0b-8741ff876487 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:52.799834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271178-4f0e-44ae-af0b-8741ff876487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:52.821277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a4470-080c-4305-8578-b7fb4e69dda8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:52.822679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30271178-4f0e-44ae-af0b-8741ff876487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:52.824177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30271178-4f0e-44ae-af0b-8741ff876487 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-30271178-4f0e-44ae-af0b-8741ff876487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:18:52.850881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:18:52.851749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:18:52.852562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:18:52.852562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:18:52.852562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:18:52.852562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:18:52.852562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 15/27] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:18:52.853548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7a0ba-0654-4d54-a4b4-237a0fd3c435 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:52.853548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7a0ba-0654-4d54-a4b4-237a0fd3c435 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:52.854750 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7a0ba-0654-4d54-a4b4-237a0fd3c435 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:52.855052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 16/28] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:18:52.863991 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722cdc2-800b-4491-9da2-b478357f923f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:52.864500 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722cdc2-800b-4491-9da2-b478357f923f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:52.864920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722cdc2-800b-4491-9da2-b478357f923f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:52.884556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c60de-717c-4086-87e5-7ba0c81d7e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:52.885529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c60de-717c-4086-87e5-7ba0c81d7e20 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:52.885655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f722cdc2-800b-4491-9da2-b478357f923f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:52.886145 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c60de-717c-4086-87e5-7ba0c81d7e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:52.886607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c60de-717c-4086-87e5-7ba0c81d7e20 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:52.886890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f722cdc2-800b-4491-9da2-b478357f923f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:52.887730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c60de-717c-4086-87e5-7ba0c81d7e20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:18:52.888239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c60de-717c-4086-87e5-7ba0c81d7e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:52.891008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c60de-717c-4086-87e5-7ba0c81d7e20 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:52.906383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 13/29] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:18:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:18:52.907466 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c60de-717c-4086-87e5-7ba0c81d7e20 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:52.952791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:52.961540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:52.973105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 17/30] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:18:52.974629 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49b8f-5af3-4c5e-bd32-68b7facf3fb7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:52.975092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49b8f-5af3-4c5e-bd32-68b7facf3fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:52.975524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad49b8f-5af3-4c5e-bd32-68b7facf3fb7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:52.977109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 18/31] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:18:52.982007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad49b8f-5af3-4c5e-bd32-68b7facf3fb7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:53.033359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c60de-717c-4086-87e5-7ba0c81d7e20 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:53.071085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398825e1-1071-4f63-837b-eab65d6769b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:53.071811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398825e1-1071-4f63-837b-eab65d6769b8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:53.072184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398825e1-1071-4f63-837b-eab65d6769b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:53.072560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398825e1-1071-4f63-837b-eab65d6769b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:53.073622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398825e1-1071-4f63-837b-eab65d6769b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:18:53.073728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398825e1-1071-4f63-837b-eab65d6769b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:53.075182 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398825e1-1071-4f63-837b-eab65d6769b8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:53.088892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 14/32] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:18:53.090304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2254f7-41d7-47a8-9bea-bc2914ddc136 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:53.090650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2254f7-41d7-47a8-9bea-bc2914ddc136 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:53.090995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2254f7-41d7-47a8-9bea-bc2914ddc136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:53.110159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1e2254f7-41d7-47a8-9bea-bc2914ddc136 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:53.111569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1e2254f7-41d7-47a8-9bea-bc2914ddc136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:53.113299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad49b8f-5af3-4c5e-bd32-68b7facf3fb7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:53.152376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cd3ae-5913-4977-a1c5-c2a742f79b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:53.153334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cd3ae-5913-4977-a1c5-c2a742f79b23 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:53.153791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cd3ae-5913-4977-a1c5-c2a742f79b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:53.154270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cd3ae-5913-4977-a1c5-c2a742f79b23 None admin] PATH_INFO: `/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:53.156555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cd3ae-5913-4977-a1c5-c2a742f79b23 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a78ca62f5c4d3896c5e2f1cd4cb186)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:53.158432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cd3ae-5913-4977-a1c5-c2a742f79b23 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:53.165504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 19/33] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:18:52 2022] GET /identity/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:18:53.166760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cd3ae-5913-4977-a1c5-c2a742f79b23 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:53.193186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 15/34] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:18:53.193186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2254f7-41d7-47a8-9bea-bc2914ddc136 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:53.218417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:53.254376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:53.305826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cd3ae-5913-4977-a1c5-c2a742f79b23 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:53.310242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2254f7-41d7-47a8-9bea-bc2914ddc136 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:53.345144 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9955ec-0e18-49cb-841c-1a6750cb9c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:53.345756 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9955ec-0e18-49cb-841c-1a6750cb9c55 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:53.346038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9955ec-0e18-49cb-841c-1a6750cb9c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:53.346312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9955ec-0e18-49cb-841c-1a6750cb9c55 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:53.347107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9955ec-0e18-49cb-841c-1a6750cb9c55 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:53.348413 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9955ec-0e18-49cb-841c-1a6750cb9c55 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:53.356026 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f6484-a365-4fab-97e6-417f64aeacb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:53.356850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f6484-a365-4fab-97e6-417f64aeacb0 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:53.357221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f6484-a365-4fab-97e6-417f64aeacb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:53.357502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f6484-a365-4fab-97e6-417f64aeacb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:53.358972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f6484-a365-4fab-97e6-417f64aeacb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:53.360499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f6484-a365-4fab-97e6-417f64aeacb0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:53.572388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 20/35] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 05:18:53 2022] POST /identity/v3/roles => generated 219 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:18:53.573945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9955ec-0e18-49cb-841c-1a6750cb9c55 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:53.586884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 16/36] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:18:53 2022] POST /identity/v3/projects => generated 301 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:18:53.587662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f6484-a365-4fab-97e6-417f64aeacb0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:53.729299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9955ec-0e18-49cb-841c-1a6750cb9c55 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:53.748755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:53.752012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:53.782448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20796244-6497-4cab-93bb-6ea814cec0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:53.783330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20796244-6497-4cab-93bb-6ea814cec0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:53.783956 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20796244-6497-4cab-93bb-6ea814cec0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:53.784241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20796244-6497-4cab-93bb-6ea814cec0f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:53.786772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20796244-6497-4cab-93bb-6ea814cec0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:53.788402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20796244-6497-4cab-93bb-6ea814cec0f9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:53.791097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 21/37] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:18:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:18:53.792179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f174b-3f06-4421-a102-03b8c6533f77 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:53.792521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f6484-a365-4fab-97e6-417f64aeacb0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:53.792627 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f174b-3f06-4421-a102-03b8c6533f77 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:53.792803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f174b-3f06-4421-a102-03b8c6533f77 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:53.794316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 22/38] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:18:53.800184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f174b-3f06-4421-a102-03b8c6533f77 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:53.838271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0942196-5c4f-45e5-9660-5d5d2bd1ed3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:53.838842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942196-5c4f-45e5-9660-5d5d2bd1ed3a None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:53.839390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942196-5c4f-45e5-9660-5d5d2bd1ed3a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:53.839592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942196-5c4f-45e5-9660-5d5d2bd1ed3a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:53.840656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0942196-5c4f-45e5-9660-5d5d2bd1ed3a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:53.843524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0942196-5c4f-45e5-9660-5d5d2bd1ed3a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:53.924002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f174b-3f06-4421-a102-03b8c6533f77 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:53.924677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 17/39] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 05:18:53 2022] POST /identity/v3/roles => generated 225 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:18:53.928123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0c6d7-bad3-488e-a9ef-e8037d9df456 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:53.928611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0c6d7-bad3-488e-a9ef-e8037d9df456 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:53.928950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0c6d7-bad3-488e-a9ef-e8037d9df456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:53.958258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-08b0c6d7-bad3-488e-a9ef-e8037d9df456 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:53.960852 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-08b0c6d7-bad3-488e-a9ef-e8037d9df456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:53.972450 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9656305-eeb5-4ec8-8ee9-873714df1f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:53.973290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9656305-eeb5-4ec8-8ee9-873714df1f90 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:53.974184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9656305-eeb5-4ec8-8ee9-873714df1f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:53.974464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9656305-eeb5-4ec8-8ee9-873714df1f90 None admin] PATH_INFO: `/v3/domains/default/users/c8a78ca62f5c4d3896c5e2f1cd4cb186/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:53.977046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9656305-eeb5-4ec8-8ee9-873714df1f90 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c8a78ca62f5c4d3896c5e2f1cd4cb186, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:53.979248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9656305-eeb5-4ec8-8ee9-873714df1f90 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:54.053035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 23/40] 10.222.0.42 () {58 vars in 1361 bytes} [Thu Jul 28 05:18:53 2022] PUT /identity/v3/domains/default/users/c8a78ca62f5c4d3896c5e2f1cd4cb186/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:18:54.059024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 18/41] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:18:54.061502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cca00e-eae4-4bcd-ad10-2d2a68ff455b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:54.062540 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cca00e-eae4-4bcd-ad10-2d2a68ff455b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:54.062871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cca00e-eae4-4bcd-ad10-2d2a68ff455b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:54.064545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 24/42] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:18:54.070428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf5d24-eeb6-49e4-8a87-013de9c196e1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:54.070725 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf5d24-eeb6-49e4-8a87-013de9c196e1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:54.071007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf5d24-eeb6-49e4-8a87-013de9c196e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:54.092211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-89bf5d24-eeb6-49e4-8a87-013de9c196e1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:54.093841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-89bf5d24-eeb6-49e4-8a87-013de9c196e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:54.095351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cca00e-eae4-4bcd-ad10-2d2a68ff455b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:54.156580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:54.188586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:54.197180 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 19/43] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:18:54.217215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf5d24-eeb6-49e4-8a87-013de9c196e1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:54.244522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cca00e-eae4-4bcd-ad10-2d2a68ff455b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:54.281820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768de8c-05a1-4504-99e2-7b42ae24c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:54.282453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768de8c-05a1-4504-99e2-7b42ae24c33a None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:54.282742 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768de8c-05a1-4504-99e2-7b42ae24c33a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:54.283021 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768de8c-05a1-4504-99e2-7b42ae24c33a None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:54.283757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768de8c-05a1-4504-99e2-7b42ae24c33a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:54.285166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768de8c-05a1-4504-99e2-7b42ae24c33a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:54.326191 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf5d24-eeb6-49e4-8a87-013de9c196e1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:54.362175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 25/44] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 05:18:54 2022] POST /identity/v3/roles => generated 223 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:18:54.362545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b0af-b6ac-4196-9728-83ba21de0cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:54.363413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b0af-b6ac-4196-9728-83ba21de0cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:54.363864 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b0af-b6ac-4196-9728-83ba21de0cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:54.364278 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b0af-b6ac-4196-9728-83ba21de0cc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:54.365880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0b0af-b6ac-4196-9728-83ba21de0cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:54.367606 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0b0af-b6ac-4196-9728-83ba21de0cc0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:54.369885 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 20/45] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:18:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:18:54.375992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768de8c-05a1-4504-99e2-7b42ae24c33a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:54.491505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768de8c-05a1-4504-99e2-7b42ae24c33a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:54.493188 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:54.529937 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc727b-4f1d-4bcd-bf30-ad2c1628e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:54.531115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc727b-4f1d-4bcd-bf30-ad2c1628e91b None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:54.531395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc727b-4f1d-4bcd-bf30-ad2c1628e91b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:54.531672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc727b-4f1d-4bcd-bf30-ad2c1628e91b None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:54.532378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc727b-4f1d-4bcd-bf30-ad2c1628e91b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:54.533897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc727b-4f1d-4bcd-bf30-ad2c1628e91b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:54.636341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 26/46] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:18:54 2022] POST /identity/v3/projects => generated 312 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:18:56.087545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805afa2-5857-4358-9630-6bf39a56c07e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:56.088060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805afa2-5857-4358-9630-6bf39a56c07e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:56.088217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805afa2-5857-4358-9630-6bf39a56c07e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:56.089634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 21/47] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:18:56.095400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3b96a-d696-4b37-b09f-484514b254d2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:56.095822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3b96a-d696-4b37-b09f-484514b254d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:56.095972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3b96a-d696-4b37-b09f-484514b254d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:56.114790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7ee3b96a-d696-4b37-b09f-484514b254d2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:56.116357 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7ee3b96a-d696-4b37-b09f-484514b254d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:56.185279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 27/48] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:18:56.208190 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805afa2-5857-4358-9630-6bf39a56c07e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:56.274600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:56.309616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805afa2-5857-4358-9630-6bf39a56c07e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:56.343355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aa67e-edd1-47de-bbae-1009804c4cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:56.344003 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aa67e-edd1-47de-bbae-1009804c4cff None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:56.344293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aa67e-edd1-47de-bbae-1009804c4cff None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:56.344571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aa67e-edd1-47de-bbae-1009804c4cff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:56.354598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6aa67e-edd1-47de-bbae-1009804c4cff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-be6aa67e-edd1-47de-bbae-1009804c4cff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:18:56.360007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:18:56.360847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:18:56.361742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 22/49] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:18:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:18:56.367101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3b96a-d696-4b37-b09f-484514b254d2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:56.449579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:56.464886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3b96a-d696-4b37-b09f-484514b254d2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:56.498667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055c1fa-49d6-4591-beb7-ddcd4fefed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:56.499910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055c1fa-49d6-4591-beb7-ddcd4fefed66 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:56.500200 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055c1fa-49d6-4591-beb7-ddcd4fefed66 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:56.500483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055c1fa-49d6-4591-beb7-ddcd4fefed66 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:56.501241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055c1fa-49d6-4591-beb7-ddcd4fefed66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:18:56.501612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055c1fa-49d6-4591-beb7-ddcd4fefed66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:56.503015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055c1fa-49d6-4591-beb7-ddcd4fefed66 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:56.511188 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 28/50] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:18:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:18:56.517425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aa67e-edd1-47de-bbae-1009804c4cff None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:56.617634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aa67e-edd1-47de-bbae-1009804c4cff None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:56.644126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:56.651812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54132e-63bc-4476-a1a7-be6f1130aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:56.652458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54132e-63bc-4476-a1a7-be6f1130aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:56.652737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54132e-63bc-4476-a1a7-be6f1130aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:56.653009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54132e-63bc-4476-a1a7-be6f1130aeb7 None admin] PATH_INFO: `/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:56.654446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54132e-63bc-4476-a1a7-be6f1130aeb7 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a78ca62f5c4d3896c5e2f1cd4cb186)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:56.656040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b868-9b2f-46f6-8bce-6984f384b66f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:56.656147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54132e-63bc-4476-a1a7-be6f1130aeb7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:56.656335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b868-9b2f-46f6-8bce-6984f384b66f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:56.656611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b868-9b2f-46f6-8bce-6984f384b66f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:56.657674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 23/51] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:18:56 2022] GET /identity/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:18:56.661175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 29/52] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:18:56.662882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6b868-9b2f-46f6-8bce-6984f384b66f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:56.663002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81afe9-677c-4bc8-8e94-5bd26b359a50 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:56.663252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81afe9-677c-4bc8-8e94-5bd26b359a50 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:56.663530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81afe9-677c-4bc8-8e94-5bd26b359a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:56.682393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1f81afe9-677c-4bc8-8e94-5bd26b359a50 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:56.683579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1f81afe9-677c-4bc8-8e94-5bd26b359a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:56.750703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 24/53] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:18:56.763638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6b868-9b2f-46f6-8bce-6984f384b66f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:56.773795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81afe9-677c-4bc8-8e94-5bd26b359a50 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:56.797459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18fe4e-964f-4a9f-914e-954b9adea5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:56.798100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18fe4e-964f-4a9f-914e-954b9adea5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:56.798381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18fe4e-964f-4a9f-914e-954b9adea5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:56.798658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18fe4e-964f-4a9f-914e-954b9adea5f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:56.799801 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18fe4e-964f-4a9f-914e-954b9adea5f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:56.801284 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18fe4e-964f-4a9f-914e-954b9adea5f6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:56.802867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 30/54] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:18:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:18:56.808859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18fe4e-964f-4a9f-914e-954b9adea5f6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:56.824528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:56.873030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81afe9-677c-4bc8-8e94-5bd26b359a50 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:56.899051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:56.907512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18fe4e-964f-4a9f-914e-954b9adea5f6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:56.907681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2516037-4674-4d26-a9c1-626c2780b9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:56.908231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2516037-4674-4d26-a9c1-626c2780b9ce None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:56.908511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2516037-4674-4d26-a9c1-626c2780b9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:56.908783 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2516037-4674-4d26-a9c1-626c2780b9ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:56.909968 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2516037-4674-4d26-a9c1-626c2780b9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:56.912049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2516037-4674-4d26-a9c1-626c2780b9ce None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:56.913669 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 25/55] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:18:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:18:56.919162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2516037-4674-4d26-a9c1-626c2780b9ce None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:56.943200 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed4ba4-0b93-4877-bfe6-cb96a927615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:56.943825 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4ba4-0b93-4877-bfe6-cb96a927615a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:56.944107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4ba4-0b93-4877-bfe6-cb96a927615a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:56.944382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed4ba4-0b93-4877-bfe6-cb96a927615a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:56.945296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed4ba4-0b93-4877-bfe6-cb96a927615a None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.domain.id=default, user.id=c8a78ca62f5c4d3896c5e2f1cd4cb186) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:18:56.945612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed4ba4-0b93-4877-bfe6-cb96a927615a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:56.947059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed4ba4-0b93-4877-bfe6-cb96a927615a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:56.952773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 31/56] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 05:18:56 2022] GET /identity/v3/role_assignments?user.id=c8a78ca62f5c4d3896c5e2f1cd4cb186&scope.domain.id=default&role.id=57a86ff4c9de433399662eebf6893065 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:18:57.024187 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2516037-4674-4d26-a9c1-626c2780b9ce None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:57.059524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8444d-72c2-4f67-9823-10e88d7a0249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:57.060168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8444d-72c2-4f67-9823-10e88d7a0249 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:57.060457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8444d-72c2-4f67-9823-10e88d7a0249 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:57.060737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8444d-72c2-4f67-9823-10e88d7a0249 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:57.062051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8444d-72c2-4f67-9823-10e88d7a0249 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:57.063711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8444d-72c2-4f67-9823-10e88d7a0249 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:57.164146 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 26/57] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 05:18:56 2022] POST /identity/v3/projects => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:18:59.146978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13877f-610e-45a8-9d62-f282f2aa0a6d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:59.147522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13877f-610e-45a8-9d62-f282f2aa0a6d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:59.147522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13877f-610e-45a8-9d62-f282f2aa0a6d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:59.148864 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 32/58] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:18:59.153933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ff77-7f17-4f2a-b16a-b5a23e868e52 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:59.154297 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ff77-7f17-4f2a-b16a-b5a23e868e52 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:59.154481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ff77-7f17-4f2a-b16a-b5a23e868e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:59.172712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c495ff77-7f17-4f2a-b16a-b5a23e868e52 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:18:59.173948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c495ff77-7f17-4f2a-b16a-b5a23e868e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:18:59.214136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:59.237470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 27/59] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:18:59.260889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13877f-610e-45a8-9d62-f282f2aa0a6d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:59.339995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:18:59.361773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13877f-610e-45a8-9d62-f282f2aa0a6d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:59.393677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc846104-f818-4949-94c6-11b438e05d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:59.394305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc846104-f818-4949-94c6-11b438e05d16 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:59.394586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc846104-f818-4949-94c6-11b438e05d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:59.394857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc846104-f818-4949-94c6-11b438e05d16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:59.395988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc846104-f818-4949-94c6-11b438e05d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:59.397525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc846104-f818-4949-94c6-11b438e05d16 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:59.399026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 33/60] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:18:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:18:59.404486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495ff77-7f17-4f2a-b16a-b5a23e868e52 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:18:59.500307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495ff77-7f17-4f2a-b16a-b5a23e868e52 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:18:59.532608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbd8fe-0852-4ee9-82db-947f7cd5f470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:18:59.533228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbd8fe-0852-4ee9-82db-947f7cd5f470 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:18:59.533510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbd8fe-0852-4ee9-82db-947f7cd5f470 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:18:59.533781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbd8fe-0852-4ee9-82db-947f7cd5f470 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:18:59.534450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbd8fe-0852-4ee9-82db-947f7cd5f470 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:18:59.535894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbd8fe-0852-4ee9-82db-947f7cd5f470 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:18:59.628209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 28/61] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:18:59 2022] POST /identity/v3/users => generated 275 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:19:02.819143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918d2b9-babc-49c6-a789-6089b0728cb8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:02.820138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918d2b9-babc-49c6-a789-6089b0728cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:02.820616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918d2b9-babc-49c6-a789-6089b0728cb8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:02.822196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 34/62] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:02.827650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5efe7-6c65-4472-b631-48330ae224ce None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:02.828455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5efe7-6c65-4472-b631-48330ae224ce None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:02.828940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5efe7-6c65-4472-b631-48330ae224ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:02.848207 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9ff5efe7-6c65-4472-b631-48330ae224ce None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:02.849713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9ff5efe7-6c65-4472-b631-48330ae224ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:02.869252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674ce4d-9b07-4590-93fb-532574a86ec4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:02.874759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674ce4d-9b07-4590-93fb-532574a86ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:02.874759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674ce4d-9b07-4590-93fb-532574a86ec4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:02.874759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 35/63] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:02.878281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a6bd-e031-4504-a146-9bf329e18469 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:02.878769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a6bd-e031-4504-a146-9bf329e18469 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:02.879251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a6bd-e031-4504-a146-9bf329e18469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:02.899914 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2490a6bd-e031-4504-a146-9bf329e18469 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:02.901475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2490a6bd-e031-4504-a146-9bf329e18469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:02.914432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:02.971421 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 29/64] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:03.010074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5efe7-6c65-4472-b631-48330ae224ce None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:03.046758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 36/65] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:03.086749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490a6bd-e031-4504-a146-9bf329e18469 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:03.178430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:03.204845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490a6bd-e031-4504-a146-9bf329e18469 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:03.211099 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5efe7-6c65-4472-b631-48330ae224ce None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:03.244481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb9a7a-34e5-4489-afb6-0600382d513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:03.245484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb9a7a-34e5-4489-afb6-0600382d513e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.245913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb9a7a-34e5-4489-afb6-0600382d513e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.246328 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb9a7a-34e5-4489-afb6-0600382d513e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.247257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1ebd6-cf87-42d7-8b75-693f8ef58f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:03.248081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1ebd6-cf87-42d7-8b75-693f8ef58f3a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.249177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1ebd6-cf87-42d7-8b75-693f8ef58f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.249850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1ebd6-cf87-42d7-8b75-693f8ef58f3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.257995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb9a7a-34e5-4489-afb6-0600382d513e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:03.260789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1ebd6-cf87-42d7-8b75-693f8ef58f3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3ccb9a7a-34e5-4489-afb6-0600382d513e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:03.263191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:03.264995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:03.265976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 37/66] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:03.266604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73d5c7-a7b6-445f-b8fe-710a08969f67 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.266604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73d5c7-a7b6-445f-b8fe-710a08969f67 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.266723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73d5c7-a7b6-445f-b8fe-710a08969f67 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.268384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 38/67] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9bb1ebd6-cf87-42d7-8b75-693f8ef58f3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:03.270530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:03.271382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:03.272151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:03.274111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b1c43-76e5-4374-acc1-b25f7f9048a7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.274400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b1c43-76e5-4374-acc1-b25f7f9048a7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.274674 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b1c43-76e5-4374-acc1-b25f7f9048a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.275060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 30/68] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:19:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:03.275925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1ebd6-cf87-42d7-8b75-693f8ef58f3a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:03.293800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cd0b1c43-76e5-4374-acc1-b25f7f9048a7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:03.295259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cd0b1c43-76e5-4374-acc1-b25f7f9048a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:03.303249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:03.371478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 39/69] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:03.372884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b1c43-76e5-4374-acc1-b25f7f9048a7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:03.394716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1ebd6-cf87-42d7-8b75-693f8ef58f3a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:03.432580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bce07-9c25-49cd-80f5-859a919797cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:03.433336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bce07-9c25-49cd-80f5-859a919797cf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.433618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bce07-9c25-49cd-80f5-859a919797cf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.434043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bce07-9c25-49cd-80f5-859a919797cf None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.435014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bce07-9c25-49cd-80f5-859a919797cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:03.435544 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bce07-9c25-49cd-80f5-859a919797cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:03.437824 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bce07-9c25-49cd-80f5-859a919797cf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:03.446204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:03.446665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 31/70] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:03.447940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61938cc-3160-4ce4-bca9-d3ae66d86668 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.448233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61938cc-3160-4ce4-bca9-d3ae66d86668 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.448504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61938cc-3160-4ce4-bca9-d3ae66d86668 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.449895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 32/71] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:03.454752 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61938cc-3160-4ce4-bca9-d3ae66d86668 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:03.491390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b1c43-76e5-4374-acc1-b25f7f9048a7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:03.527787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a95fe3-81da-4728-9d99-c0d21edb9d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:03.528751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a95fe3-81da-4728-9d99-c0d21edb9d95 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.529318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a95fe3-81da-4728-9d99-c0d21edb9d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.529779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a95fe3-81da-4728-9d99-c0d21edb9d95 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.530951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a95fe3-81da-4728-9d99-c0d21edb9d95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:03.531396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a95fe3-81da-4728-9d99-c0d21edb9d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:03.532905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a95fe3-81da-4728-9d99-c0d21edb9d95 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:03.541995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 40/72] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:03.543138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a95fe3-81da-4728-9d99-c0d21edb9d95 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:03.545048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:03.564399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61938cc-3160-4ce4-bca9-d3ae66d86668 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:03.598423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763005f-c88e-43a3-b871-a3c631b045cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:03.599070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763005f-c88e-43a3-b871-a3c631b045cf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.599608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763005f-c88e-43a3-b871-a3c631b045cf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.599608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763005f-c88e-43a3-b871-a3c631b045cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.610073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763005f-c88e-43a3-b871-a3c631b045cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4763005f-c88e-43a3-b871-a3c631b045cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:03.614997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:03.616048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:03.616833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 33/73] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:03.617533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3892f9-df40-4f2b-9f9e-d31eb2209540 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.617998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3892f9-df40-4f2b-9f9e-d31eb2209540 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.617998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3892f9-df40-4f2b-9f9e-d31eb2209540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.635908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bf3892f9-df40-4f2b-9f9e-d31eb2209540 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:03.637157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bf3892f9-df40-4f2b-9f9e-d31eb2209540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:03.643593 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a95fe3-81da-4728-9d99-c0d21edb9d95 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:03.669058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:03.677429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a71c0-b117-4195-b02c-3d21783f392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:03.678071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a71c0-b117-4195-b02c-3d21783f392a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.678358 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a71c0-b117-4195-b02c-3d21783f392a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.678635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a71c0-b117-4195-b02c-3d21783f392a None admin] PATH_INFO: `/v3/users/a2a04f508a86457da1ddb1c8676d939d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.692463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a71c0-b117-4195-b02c-3d21783f392a None admin] RBAC: Authorizing `identity:get_user(user_id=a2a04f508a86457da1ddb1c8676d939d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:03.699535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a71c0-b117-4195-b02c-3d21783f392a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:03.699535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 41/74] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:03 2022] GET /identity/v3/users/a2a04f508a86457da1ddb1c8676d939d => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:03.699535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a71c0-b117-4195-b02c-3d21783f392a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:03.704038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 34/75] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:03.705386 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3d2dd-9b05-4122-bd0b-1d130bce44e8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.705680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3d2dd-9b05-4122-bd0b-1d130bce44e8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.705953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3d2dd-9b05-4122-bd0b-1d130bce44e8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.709451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 35/76] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:03.709451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3d2dd-9b05-4122-bd0b-1d130bce44e8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:03.785976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:03.799225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a71c0-b117-4195-b02c-3d21783f392a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:03.810829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3d2dd-9b05-4122-bd0b-1d130bce44e8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:03.833579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25e1a0-4327-4bbb-a3f6-e8a04573f82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:03.834226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25e1a0-4327-4bbb-a3f6-e8a04573f82e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.834509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25e1a0-4327-4bbb-a3f6-e8a04573f82e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.834786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25e1a0-4327-4bbb-a3f6-e8a04573f82e None admin] PATH_INFO: `/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.835958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25e1a0-4327-4bbb-a3f6-e8a04573f82e None admin] RBAC: Authorizing `identity:get_user(user_id=c8a78ca62f5c4d3896c5e2f1cd4cb186)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:03.837474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25e1a0-4327-4bbb-a3f6-e8a04573f82e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:03.839076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 42/77] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:03 2022] GET /identity/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:03.839844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25e1a0-4327-4bbb-a3f6-e8a04573f82e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:03.850086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cdd9b-723c-4abd-b2df-e768cb6ddf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:03.850769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cdd9b-723c-4abd-b2df-e768cb6ddf93 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.851056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cdd9b-723c-4abd-b2df-e768cb6ddf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.851333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cdd9b-723c-4abd-b2df-e768cb6ddf93 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.852082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cdd9b-723c-4abd-b2df-e768cb6ddf93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:03.852389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cdd9b-723c-4abd-b2df-e768cb6ddf93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:03.853804 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cdd9b-723c-4abd-b2df-e768cb6ddf93 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:03.862515 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 36/78] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:03.863886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47797fbc-cdc9-43b9-8625-30992546c9de None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.864171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47797fbc-cdc9-43b9-8625-30992546c9de None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.864448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47797fbc-cdc9-43b9-8625-30992546c9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:03.882318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-47797fbc-cdc9-43b9-8625-30992546c9de None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:03.883511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-47797fbc-cdc9-43b9-8625-30992546c9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:03.895144 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:03.939470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25e1a0-4327-4bbb-a3f6-e8a04573f82e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:03.949303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 37/79] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:03.950476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47797fbc-cdc9-43b9-8625-30992546c9de None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:03.975850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3359898-5df0-4636-b976-d9ecd9c5a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:03.976469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3359898-5df0-4636-b976-d9ecd9c5a92a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:03.976745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3359898-5df0-4636-b976-d9ecd9c5a92a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:03.977019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3359898-5df0-4636-b976-d9ecd9c5a92a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:04.015887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:04.043456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3359898-5df0-4636-b976-d9ecd9c5a92a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:04.044985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3359898-5df0-4636-b976-d9ecd9c5a92a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:04.051592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47797fbc-cdc9-43b9-8625-30992546c9de None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:04.084461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb3b96-1b50-423c-bd79-ee160a1fab23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:04.085097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb3b96-1b50-423c-bd79-ee160a1fab23 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:04.085408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb3b96-1b50-423c-bd79-ee160a1fab23 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:04.086028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb3b96-1b50-423c-bd79-ee160a1fab23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:04.096968 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb3b96-1b50-423c-bd79-ee160a1fab23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:04.099608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3aeb3b96-1b50-423c-bd79-ee160a1fab23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:04.102189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:04.103064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:04.103923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 38/80] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:04.104603 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb3b96-1b50-423c-bd79-ee160a1fab23 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:04.147299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 43/81] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:04.152514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3359898-5df0-4636-b976-d9ecd9c5a92a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:04.206941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb3b96-1b50-423c-bd79-ee160a1fab23 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:04.232051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:04.241281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f407e-0abb-4a82-b106-cee9567b1c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:04.246388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f407e-0abb-4a82-b106-cee9567b1c2a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:04.246388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f407e-0abb-4a82-b106-cee9567b1c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:04.246388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f407e-0abb-4a82-b106-cee9567b1c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:04.254355 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3359898-5df0-4636-b976-d9ecd9c5a92a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:04.287929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a9681-6da7-44a4-8602-ab0ce6d53a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:04.288564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a9681-6da7-44a4-8602-ab0ce6d53a96 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:04.288843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a9681-6da7-44a4-8602-ab0ce6d53a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:04.289116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a9681-6da7-44a4-8602-ab0ce6d53a96 None admin] PATH_INFO: `/v3/users/a2a04f508a86457da1ddb1c8676d939d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:04.290304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a9681-6da7-44a4-8602-ab0ce6d53a96 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a04f508a86457da1ddb1c8676d939d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:04.291745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a9681-6da7-44a4-8602-ab0ce6d53a96 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:04.293357 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 44/82] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:04 2022] GET /identity/v3/users/a2a04f508a86457da1ddb1c8676d939d => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:04.294121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a9681-6da7-44a4-8602-ab0ce6d53a96 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:04.309195 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f407e-0abb-4a82-b106-cee9567b1c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:04.310661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f407e-0abb-4a82-b106-cee9567b1c2a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:04.318556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:04.393947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a9681-6da7-44a4-8602-ab0ce6d53a96 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:04.408690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 39/83] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:04.410259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f407e-0abb-4a82-b106-cee9567b1c2a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:04.427937 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fefd5-3d40-4f41-87d2-6e87ed6da430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:04.428583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fefd5-3d40-4f41-87d2-6e87ed6da430 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:04.428869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fefd5-3d40-4f41-87d2-6e87ed6da430 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:04.429170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fefd5-3d40-4f41-87d2-6e87ed6da430 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:04.430318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fefd5-3d40-4f41-87d2-6e87ed6da430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:04.432037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fefd5-3d40-4f41-87d2-6e87ed6da430 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:04.433656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 45/84] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:04.434417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fefd5-3d40-4f41-87d2-6e87ed6da430 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:04.438650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:04.510641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f407e-0abb-4a82-b106-cee9567b1c2a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:04.522683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:04.532063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fefd5-3d40-4f41-87d2-6e87ed6da430 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:04.544729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a319619-f2e4-4777-9f64-72aaac80c92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:04.546155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a319619-f2e4-4777-9f64-72aaac80c92b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:04.546341 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a319619-f2e4-4777-9f64-72aaac80c92b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:04.546616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a319619-f2e4-4777-9f64-72aaac80c92b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:04.547347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a319619-f2e4-4777-9f64-72aaac80c92b None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:04.547654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a319619-f2e4-4777-9f64-72aaac80c92b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:04.549047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a319619-f2e4-4777-9f64-72aaac80c92b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:04.557530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 40/85] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:04.558419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a319619-f2e4-4777-9f64-72aaac80c92b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:04.567604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5f56a-ed92-4273-83ef-7367360f71c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:04.568251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5f56a-ed92-4273-83ef-7367360f71c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:04.568535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5f56a-ed92-4273-83ef-7367360f71c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:04.568811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5f56a-ed92-4273-83ef-7367360f71c1 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:04.569999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5f56a-ed92-4273-83ef-7367360f71c1 None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:04.571464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5f56a-ed92-4273-83ef-7367360f71c1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:04.573116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 46/86] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:04 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:04.573894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5f56a-ed92-4273-83ef-7367360f71c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:04.643571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:04.656355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a319619-f2e4-4777-9f64-72aaac80c92b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:04.676600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5f56a-ed92-4273-83ef-7367360f71c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:04.691569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e753c-4901-4c21-ace9-4e040409edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:04.692199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e753c-4901-4c21-ace9-4e040409edba None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:04.692469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e753c-4901-4c21-ace9-4e040409edba None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:04.692739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e753c-4901-4c21-ace9-4e040409edba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:04.710228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989f1c2-a060-47fd-a2c2-6999ba7d0fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:04.710863 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f1c2-a060-47fd-a2c2-6999ba7d0fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:04.711146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f1c2-a060-47fd-a2c2-6999ba7d0fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:04.711422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f1c2-a060-47fd-a2c2-6999ba7d0fa3 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:04.712565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989f1c2-a060-47fd-a2c2-6999ba7d0fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:04.714072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989f1c2-a060-47fd-a2c2-6999ba7d0fa3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:04.715881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 47/87] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:04 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:04.716534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989f1c2-a060-47fd-a2c2-6999ba7d0fa3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:04.743276 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:04.761917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e753c-4901-4c21-ace9-4e040409edba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:04.763399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e753c-4901-4c21-ace9-4e040409edba None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:04.815275 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989f1c2-a060-47fd-a2c2-6999ba7d0fa3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:04.847643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:04.849161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bf1a2-b8d4-4ed6-a8a3-4e828919778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:04.849660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bf1a2-b8d4-4ed6-a8a3-4e828919778d None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:04.849947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bf1a2-b8d4-4ed6-a8a3-4e828919778d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:04.850218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bf1a2-b8d4-4ed6-a8a3-4e828919778d None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:04.850900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bf1a2-b8d4-4ed6-a8a3-4e828919778d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:04.852400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bf1a2-b8d4-4ed6-a8a3-4e828919778d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:04.860841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 41/88] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:04.861697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e753c-4901-4c21-ace9-4e040409edba None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:04.924738 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 48/89] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:19:04 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:19:04.930269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bf1a2-b8d4-4ed6-a8a3-4e828919778d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:04.964467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e753c-4901-4c21-ace9-4e040409edba None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:05.004114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fefdf-bfb6-44c8-9185-c11edf7f431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:05.004760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fefdf-bfb6-44c8-9185-c11edf7f431c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:05.005038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fefdf-bfb6-44c8-9185-c11edf7f431c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:05.005348 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fefdf-bfb6-44c8-9185-c11edf7f431c None admin] PATH_INFO: `/v3/users/a2a04f508a86457da1ddb1c8676d939d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:05.006652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fefdf-bfb6-44c8-9185-c11edf7f431c None admin] RBAC: Authorizing `identity:get_user(user_id=a2a04f508a86457da1ddb1c8676d939d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:05.008299 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fefdf-bfb6-44c8-9185-c11edf7f431c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:05.010176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 42/90] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:04 2022] GET /identity/v3/users/a2a04f508a86457da1ddb1c8676d939d => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:05.016260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fefdf-bfb6-44c8-9185-c11edf7f431c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:05.026934 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:05.047681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bf1a2-b8d4-4ed6-a8a3-4e828919778d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:05.080124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:05.089947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9a75-4d54-4ac9-adda-7e7642c4224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:05.090753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9a75-4d54-4ac9-adda-7e7642c4224e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:05.091026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9a75-4d54-4ac9-adda-7e7642c4224e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:05.091678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9a75-4d54-4ac9-adda-7e7642c4224e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:05.093778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade9a75-4d54-4ac9-adda-7e7642c4224e None admin] RBAC: Adding query filter params (role.id=a21446fa03b24a5ebbaf61a4827146e7, scope.project.id=86802e43046f4a66bdee6d53a4239a87, user.id=a2a04f508a86457da1ddb1c8676d939d) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:05.093778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade9a75-4d54-4ac9-adda-7e7642c4224e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:05.094828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade9a75-4d54-4ac9-adda-7e7642c4224e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:05.101059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 49/91] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:04 2022] GET /identity/v3/role_assignments?user.id=a2a04f508a86457da1ddb1c8676d939d&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:05.101708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9a75-4d54-4ac9-adda-7e7642c4224e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:05.136152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fefdf-bfb6-44c8-9185-c11edf7f431c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:05.194784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247f27e-8bb1-4ead-b254-49a6b40f2a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:05.195361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f27e-8bb1-4ead-b254-49a6b40f2a81 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:05.195643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f27e-8bb1-4ead-b254-49a6b40f2a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:05.195989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f27e-8bb1-4ead-b254-49a6b40f2a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:05.196738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247f27e-8bb1-4ead-b254-49a6b40f2a81 None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=86802e43046f4a66bdee6d53a4239a87, user.id=c8a78ca62f5c4d3896c5e2f1cd4cb186) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:05.197049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247f27e-8bb1-4ead-b254-49a6b40f2a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:05.198620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247f27e-8bb1-4ead-b254-49a6b40f2a81 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:05.214505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 43/92] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:05 2022] GET /identity/v3/role_assignments?user.id=c8a78ca62f5c4d3896c5e2f1cd4cb186&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=57a86ff4c9de433399662eebf6893065 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:05.216084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247f27e-8bb1-4ead-b254-49a6b40f2a81 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:05.247272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9a75-4d54-4ac9-adda-7e7642c4224e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:05.305027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4aeee-319d-44d3-8127-9966c4152873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:05.306286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4aeee-319d-44d3-8127-9966c4152873 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:05.306783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4aeee-319d-44d3-8127-9966c4152873 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:05.307060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4aeee-319d-44d3-8127-9966c4152873 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:05.308307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4aeee-319d-44d3-8127-9966c4152873 None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:05.309924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4aeee-319d-44d3-8127-9966c4152873 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:05.311911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 50/93] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:05 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:05.320990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4aeee-319d-44d3-8127-9966c4152873 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:05.344960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:05.391305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247f27e-8bb1-4ead-b254-49a6b40f2a81 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:05.421413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:05.439646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acffad-eb6a-40da-a959-be77945ad68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:05.441124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acffad-eb6a-40da-a959-be77945ad68c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:05.441441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acffad-eb6a-40da-a959-be77945ad68c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:05.441722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acffad-eb6a-40da-a959-be77945ad68c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:05.478808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4aeee-319d-44d3-8127-9966c4152873 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:05.520433 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b93c5b-0662-42cc-8ca0-08e47c474b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:05.522493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b93c5b-0662-42cc-8ca0-08e47c474b9b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:05.523031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b93c5b-0662-42cc-8ca0-08e47c474b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:05.523510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b93c5b-0662-42cc-8ca0-08e47c474b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:05.524656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b93c5b-0662-42cc-8ca0-08e47c474b9b None admin] RBAC: Adding query filter params (role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7, scope.project.id=86802e43046f4a66bdee6d53a4239a87, user.id=a2a04f508a86457da1ddb1c8676d939d) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:05.525182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b93c5b-0662-42cc-8ca0-08e47c474b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:05.526872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b93c5b-0662-42cc-8ca0-08e47c474b9b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:05.532262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acffad-eb6a-40da-a959-be77945ad68c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:05.533812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acffad-eb6a-40da-a959-be77945ad68c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:05.534040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 51/94] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:05 2022] GET /identity/v3/role_assignments?user.id=a2a04f508a86457da1ddb1c8676d939d&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:05.670225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 44/95] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:05.676329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b93c5b-0662-42cc-8ca0-08e47c474b9b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:05.771079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:05.795778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b93c5b-0662-42cc-8ca0-08e47c474b9b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:05.832325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91127000-6ae9-4302-b58b-7d2e6bf68fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:05.833365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127000-6ae9-4302-b58b-7d2e6bf68fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:05.833842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127000-6ae9-4302-b58b-7d2e6bf68fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:05.834328 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127000-6ae9-4302-b58b-7d2e6bf68fd2 None admin] PATH_INFO: `/v3/projects/32c3ded2af2e402e86f03295baff44ce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:05.835713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91127000-6ae9-4302-b58b-7d2e6bf68fd2 None admin] RBAC: Authorizing `identity:get_project(project_id=32c3ded2af2e402e86f03295baff44ce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:05.837413 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91127000-6ae9-4302-b58b-7d2e6bf68fd2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:05.839277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 52/96] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:05 2022] GET /identity/v3/projects/32c3ded2af2e402e86f03295baff44ce => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:05.846016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acffad-eb6a-40da-a959-be77945ad68c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:05.876829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:06.009556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acffad-eb6a-40da-a959-be77945ad68c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:06.056623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a430b-b852-4cfb-b8fe-04d37f022779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:06.057607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a430b-b852-4cfb-b8fe-04d37f022779 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:06.058084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a430b-b852-4cfb-b8fe-04d37f022779 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:06.058568 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a430b-b852-4cfb-b8fe-04d37f022779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:06.059546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a430b-b852-4cfb-b8fe-04d37f022779 None admin] RBAC: Adding query filter params (role.id=a21446fa03b24a5ebbaf61a4827146e7, scope.project.id=32c3ded2af2e402e86f03295baff44ce, user.id=a2a04f508a86457da1ddb1c8676d939d) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:06.060048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a430b-b852-4cfb-b8fe-04d37f022779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:06.062595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a430b-b852-4cfb-b8fe-04d37f022779 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:06.068373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 45/97] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:05 2022] GET /identity/v3/role_assignments?user.id=a2a04f508a86457da1ddb1c8676d939d&scope.project.id=32c3ded2af2e402e86f03295baff44ce&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:07.929418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f59727-2222-4100-9983-5c368789cac5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:07.929921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f59727-2222-4100-9983-5c368789cac5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:07.929993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f59727-2222-4100-9983-5c368789cac5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:07.931864 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 53/98] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:07.937245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00ced-2251-44e9-9bb4-67819e112b9c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:07.938098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00ced-2251-44e9-9bb4-67819e112b9c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:07.938567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00ced-2251-44e9-9bb4-67819e112b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:07.962348 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-17e00ced-2251-44e9-9bb4-67819e112b9c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:07.963874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-17e00ced-2251-44e9-9bb4-67819e112b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:08.007179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142c209-4e35-42c2-a4b4-9d282904dff6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.007179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142c209-4e35-42c2-a4b4-9d282904dff6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.007179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142c209-4e35-42c2-a4b4-9d282904dff6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.007179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 54/99] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:08.007179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733941-03e0-420a-bb1c-9c0f32762a6c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.007179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733941-03e0-420a-bb1c-9c0f32762a6c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.007693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733941-03e0-420a-bb1c-9c0f32762a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.024616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c5733941-03e0-420a-bb1c-9c0f32762a6c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:08.025879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c5733941-03e0-420a-bb1c-9c0f32762a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:08.074142 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 46/100] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:08.116217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e00ced-2251-44e9-9bb4-67819e112b9c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:08.135526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 55/101] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:08.140305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:08.195771 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5733941-03e0-420a-bb1c-9c0f32762a6c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:08.292788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e00ced-2251-44e9-9bb4-67819e112b9c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:08.316528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:08.360248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c446-2a15-4f14-baaf-1c936551381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:08.360913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c446-2a15-4f14-baaf-1c936551381e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.361222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c446-2a15-4f14-baaf-1c936551381e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.361506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c446-2a15-4f14-baaf-1c936551381e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.365310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5733941-03e0-420a-bb1c-9c0f32762a6c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:08.379913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177c446-2a15-4f14-baaf-1c936551381e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e177c446-2a15-4f14-baaf-1c936551381e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:08.384915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:08.385814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:08.386597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 47/102] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:08.394083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77bd59-2fa0-486b-abc0-8973a0f55f97 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.394374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77bd59-2fa0-486b-abc0-8973a0f55f97 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.394651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77bd59-2fa0-486b-abc0-8973a0f55f97 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.395970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 48/103] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:08.397688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77bd59-2fa0-486b-abc0-8973a0f55f97 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:08.426839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa232106-0c5e-4d02-9a74-e536a2d667bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:08.427773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232106-0c5e-4d02-9a74-e536a2d667bf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.428204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232106-0c5e-4d02-9a74-e536a2d667bf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.428624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232106-0c5e-4d02-9a74-e536a2d667bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.441520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa232106-0c5e-4d02-9a74-e536a2d667bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fa232106-0c5e-4d02-9a74-e536a2d667bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:08.448006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:08.449117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:08.450148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:08.457600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 56/104] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:19:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:08.459045 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae1b30-a5af-4208-886a-299bace98647 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.459334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae1b30-a5af-4208-886a-299bace98647 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.459614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae1b30-a5af-4208-886a-299bace98647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.478108 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9bae1b30-a5af-4208-886a-299bace98647 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:08.480621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9bae1b30-a5af-4208-886a-299bace98647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:08.505890 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:08.532334 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77bd59-2fa0-486b-abc0-8973a0f55f97 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:08.554910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 57/105] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:08.556441 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e62201-a8f0-4d51-87cd-f9ca79658493 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.556735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e62201-a8f0-4d51-87cd-f9ca79658493 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.557016 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e62201-a8f0-4d51-87cd-f9ca79658493 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.558485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 58/106] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:08.559008 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e62201-a8f0-4d51-87cd-f9ca79658493 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:08.582729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23114756-8383-4b2d-ac17-db43f67be7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:08.583642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23114756-8383-4b2d-ac17-db43f67be7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.583934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23114756-8383-4b2d-ac17-db43f67be7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.584214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23114756-8383-4b2d-ac17-db43f67be7d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.584940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23114756-8383-4b2d-ac17-db43f67be7d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:08.585284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23114756-8383-4b2d-ac17-db43f67be7d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:08.587189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23114756-8383-4b2d-ac17-db43f67be7d8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:08.595786 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 49/107] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:08.597177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddaeff-4d8e-4801-bf18-5102e4dcb635 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.597675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddaeff-4d8e-4801-bf18-5102e4dcb635 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.597951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddaeff-4d8e-4801-bf18-5102e4dcb635 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.599287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 50/108] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:08.600272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3106fad-30ee-49a0-9722-29fd19dd2bd2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.600544 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3106fad-30ee-49a0-9722-29fd19dd2bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.600883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3106fad-30ee-49a0-9722-29fd19dd2bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.621773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d3106fad-30ee-49a0-9722-29fd19dd2bd2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:08.622965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d3106fad-30ee-49a0-9722-29fd19dd2bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:08.641277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:08.678759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e62201-a8f0-4d51-87cd-f9ca79658493 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:08.694647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 51/109] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:08.706874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3106fad-30ee-49a0-9722-29fd19dd2bd2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:08.717767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432bc23-7560-46a0-a94c-2f65548469dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:08.718938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432bc23-7560-46a0-a94c-2f65548469dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.719227 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432bc23-7560-46a0-a94c-2f65548469dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.719505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432bc23-7560-46a0-a94c-2f65548469dc None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.720606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432bc23-7560-46a0-a94c-2f65548469dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:08.720924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432bc23-7560-46a0-a94c-2f65548469dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:08.722682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432bc23-7560-46a0-a94c-2f65548469dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:08.731145 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 59/110] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:08.731792 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432bc23-7560-46a0-a94c-2f65548469dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:08.784213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:08.820661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3106fad-30ee-49a0-9722-29fd19dd2bd2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:08.840642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432bc23-7560-46a0-a94c-2f65548469dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:08.856399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3bfb0-75dc-4632-9ea8-4963c333de56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:08.857058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3bfb0-75dc-4632-9ea8-4963c333de56 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.857902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3bfb0-75dc-4632-9ea8-4963c333de56 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.858181 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3bfb0-75dc-4632-9ea8-4963c333de56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.873114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3bfb0-75dc-4632-9ea8-4963c333de56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:08.874426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9dd3bfb0-75dc-4632-9ea8-4963c333de56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:08.879764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:08.880683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:08.881474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 52/111] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:08.882735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca628a-91ba-456f-bd75-32fb920ec79c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.882735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca628a-91ba-456f-bd75-32fb920ec79c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.882884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca628a-91ba-456f-bd75-32fb920ec79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.884204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91f20f-75f1-438a-98af-15d489d93b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:08.884879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f20f-75f1-438a-98af-15d489d93b81 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:08.889096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f20f-75f1-438a-98af-15d489d93b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:08.889096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f20f-75f1-438a-98af-15d489d93b81 None admin] PATH_INFO: `/v3/users/a2a04f508a86457da1ddb1c8676d939d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:08.890004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91f20f-75f1-438a-98af-15d489d93b81 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a04f508a86457da1ddb1c8676d939d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:08.892668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91f20f-75f1-438a-98af-15d489d93b81 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:08.893358 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 60/112] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:08 2022] GET /identity/v3/users/a2a04f508a86457da1ddb1c8676d939d => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:08.893963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91f20f-75f1-438a-98af-15d489d93b81 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:08.908565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2eca628a-91ba-456f-bd75-32fb920ec79c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:08.909764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2eca628a-91ba-456f-bd75-32fb920ec79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:08.986453 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 53/113] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:08.988041 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca628a-91ba-456f-bd75-32fb920ec79c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:09.014371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91f20f-75f1-438a-98af-15d489d93b81 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.049661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:09.052415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817e162-bb80-4bf4-a44f-215994f112c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:09.052983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817e162-bb80-4bf4-a44f-215994f112c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.053451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817e162-bb80-4bf4-a44f-215994f112c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.053570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817e162-bb80-4bf4-a44f-215994f112c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.065297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817e162-bb80-4bf4-a44f-215994f112c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f817e162-bb80-4bf4-a44f-215994f112c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:09.070648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:09.071572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:09.072353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 61/114] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:09.073019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817e162-bb80-4bf4-a44f-215994f112c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:09.097671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca628a-91ba-456f-bd75-32fb920ec79c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.136247 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81437f6-e53f-4a3a-9ac8-db558a310539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:09.136915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81437f6-e53f-4a3a-9ac8-db558a310539 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.137246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81437f6-e53f-4a3a-9ac8-db558a310539 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.137525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81437f6-e53f-4a3a-9ac8-db558a310539 None admin] PATH_INFO: `/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.139239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81437f6-e53f-4a3a-9ac8-db558a310539 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a78ca62f5c4d3896c5e2f1cd4cb186)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:09.140457 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:09.140705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81437f6-e53f-4a3a-9ac8-db558a310539 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:09.142530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 54/115] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:08 2022] GET /identity/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:09.143110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81437f6-e53f-4a3a-9ac8-db558a310539 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:09.196176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817e162-bb80-4bf4-a44f-215994f112c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.234458 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c8381-5fb3-4e23-8b20-c22568c92fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:09.235342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c8381-5fb3-4e23-8b20-c22568c92fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.235770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c8381-5fb3-4e23-8b20-c22568c92fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.236188 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c8381-5fb3-4e23-8b20-c22568c92fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.237120 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c8381-5fb3-4e23-8b20-c22568c92fd5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:09.237398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c8381-5fb3-4e23-8b20-c22568c92fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:09.238800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c8381-5fb3-4e23-8b20-c22568c92fd5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:09.247579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 62/116] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:09.249317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c8381-5fb3-4e23-8b20-c22568c92fd5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:09.257680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81437f6-e53f-4a3a-9ac8-db558a310539 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.282805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:09.292914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ed9bf-f5f9-4d63-baed-d6bc0d8a82b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:09.293580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ed9bf-f5f9-4d63-baed-d6bc0d8a82b4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.293860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ed9bf-f5f9-4d63-baed-d6bc0d8a82b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.294135 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ed9bf-f5f9-4d63-baed-d6bc0d8a82b4 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.295944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ed9bf-f5f9-4d63-baed-d6bc0d8a82b4 None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:09.297416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ed9bf-f5f9-4d63-baed-d6bc0d8a82b4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:09.299056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 55/117] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:09 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:09.299808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ed9bf-f5f9-4d63-baed-d6bc0d8a82b4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:09.351678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c8381-5fb3-4e23-8b20-c22568c92fd5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.368891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:09.385810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba338a3-ee70-4db0-9560-b93eddbf905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:09.386450 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba338a3-ee70-4db0-9560-b93eddbf905e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.386808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba338a3-ee70-4db0-9560-b93eddbf905e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.387092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba338a3-ee70-4db0-9560-b93eddbf905e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.388240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba338a3-ee70-4db0-9560-b93eddbf905e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:09.391884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba338a3-ee70-4db0-9560-b93eddbf905e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:09.394511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 63/118] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:09.396515 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba338a3-ee70-4db0-9560-b93eddbf905e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:09.403255 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ed9bf-f5f9-4d63-baed-d6bc0d8a82b4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.437925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd560a-073d-4fa5-bfb3-d63d4b0cdc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:09.438543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd560a-073d-4fa5-bfb3-d63d4b0cdc1c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.438828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd560a-073d-4fa5-bfb3-d63d4b0cdc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.439102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd560a-073d-4fa5-bfb3-d63d4b0cdc1c None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.439801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd560a-073d-4fa5-bfb3-d63d4b0cdc1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:09.440101 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd560a-073d-4fa5-bfb3-d63d4b0cdc1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:09.441497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd560a-073d-4fa5-bfb3-d63d4b0cdc1c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:09.449059 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 56/119] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:09.449856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd560a-073d-4fa5-bfb3-d63d4b0cdc1c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:09.497370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba338a3-ee70-4db0-9560-b93eddbf905e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.507337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:09.530720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83df5a1-d7c6-48e9-85f6-defce5c0b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:09.531352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83df5a1-d7c6-48e9-85f6-defce5c0b5dd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.531634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83df5a1-d7c6-48e9-85f6-defce5c0b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.531910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83df5a1-d7c6-48e9-85f6-defce5c0b5dd None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.533077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83df5a1-d7c6-48e9-85f6-defce5c0b5dd None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:09.534569 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83df5a1-d7c6-48e9-85f6-defce5c0b5dd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:09.536216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 64/120] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:09 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:09.541377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271319e9-e41c-4f19-a82e-dbb458e44e81 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.541377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271319e9-e41c-4f19-a82e-dbb458e44e81 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.541377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271319e9-e41c-4f19-a82e-dbb458e44e81 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.541377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 65/121] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:09.541377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271319e9-e41c-4f19-a82e-dbb458e44e81 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:09.553462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd560a-073d-4fa5-bfb3-d63d4b0cdc1c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.588218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10288d88-af0f-4a15-a96c-d7b125fe2229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:09.588859 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10288d88-af0f-4a15-a96c-d7b125fe2229 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.589170 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10288d88-af0f-4a15-a96c-d7b125fe2229 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.589457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10288d88-af0f-4a15-a96c-d7b125fe2229 None admin] PATH_INFO: `/v3/users/f8db4d19726f45248b4ee6f1db28af5b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.596910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:09.604575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10288d88-af0f-4a15-a96c-d7b125fe2229 None admin] RBAC: Authorizing `identity:get_user(user_id=f8db4d19726f45248b4ee6f1db28af5b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:09.606054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10288d88-af0f-4a15-a96c-d7b125fe2229 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:09.608280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 57/122] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:09 2022] GET /identity/v3/users/f8db4d19726f45248b4ee6f1db28af5b => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:09.609339 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10288d88-af0f-4a15-a96c-d7b125fe2229 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:09.643150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271319e9-e41c-4f19-a82e-dbb458e44e81 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.676402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2ba67-552c-4572-9863-c1ef103b46ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:09.677073 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ba67-552c-4572-9863-c1ef103b46ff None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.677374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ba67-552c-4572-9863-c1ef103b46ff None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.677647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2ba67-552c-4572-9863-c1ef103b46ff None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87/users/a2a04f508a86457da1ddb1c8676d939d/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.680671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2ba67-552c-4572-9863-c1ef103b46ff None admin] RBAC: Authorizing `identity:create_grant(project_id=86802e43046f4a66bdee6d53a4239a87, user_id=a2a04f508a86457da1ddb1c8676d939d, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:09.682164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2ba67-552c-4572-9863-c1ef103b46ff None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:09.708996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10288d88-af0f-4a15-a96c-d7b125fe2229 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.722457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:09.742229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07ea6-ff49-4c33-ac1c-c96868df8427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:09.742874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07ea6-ff49-4c33-ac1c-c96868df8427 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.743141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07ea6-ff49-4c33-ac1c-c96868df8427 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.743418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07ea6-ff49-4c33-ac1c-c96868df8427 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.744102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f07ea6-ff49-4c33-ac1c-c96868df8427 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:09.745575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f07ea6-ff49-4c33-ac1c-c96868df8427 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:09.771243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 66/123] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:19:09 2022] PUT /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87/users/a2a04f508a86457da1ddb1c8676d939d/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:09.772100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2ba67-552c-4572-9863-c1ef103b46ff None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:09.818442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 58/124] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:19:09 2022] POST /identity/v3/projects => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:19:09.818442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07ea6-ff49-4c33-ac1c-c96868df8427 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:09.909567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2ba67-552c-4572-9863-c1ef103b46ff None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.928006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:09.961082 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfce45-e6c5-4310-9293-91ca6f5c73ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:09.961780 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfce45-e6c5-4310-9293-91ca6f5c73ed None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.962130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfce45-e6c5-4310-9293-91ca6f5c73ed None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.962416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfce45-e6c5-4310-9293-91ca6f5c73ed None admin] PATH_INFO: `/v3/users/a2a04f508a86457da1ddb1c8676d939d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.963639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfce45-e6c5-4310-9293-91ca6f5c73ed None admin] RBAC: Authorizing `identity:get_user(user_id=a2a04f508a86457da1ddb1c8676d939d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:09.965155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfce45-e6c5-4310-9293-91ca6f5c73ed None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:09.967614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 67/125] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:09 2022] GET /identity/v3/users/a2a04f508a86457da1ddb1c8676d939d => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:09.968592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f0af-5d32-4312-ace7-256fe69be320 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:09.968881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f0af-5d32-4312-ace7-256fe69be320 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:09.971155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f0af-5d32-4312-ace7-256fe69be320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:09.973605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07ea6-ff49-4c33-ac1c-c96868df8427 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:09.991787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-25f2f0af-5d32-4312-ace7-256fe69be320 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:09.993033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-25f2f0af-5d32-4312-ace7-256fe69be320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:10.015809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4c5db-f730-4b75-88a1-b7a4f3d44b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:10.017203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4c5db-f730-4b75-88a1-b7a4f3d44b95 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:10.017684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4c5db-f730-4b75-88a1-b7a4f3d44b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:10.018245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4c5db-f730-4b75-88a1-b7a4f3d44b95 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87/users/c8a78ca62f5c4d3896c5e2f1cd4cb186/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:10.020617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4c5db-f730-4b75-88a1-b7a4f3d44b95 None admin] RBAC: Authorizing `identity:create_grant(project_id=86802e43046f4a66bdee6d53a4239a87, user_id=c8a78ca62f5c4d3896c5e2f1cd4cb186, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:10.022589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4c5db-f730-4b75-88a1-b7a4f3d44b95 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:10.072658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 68/126] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:10.073565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2f0af-5d32-4312-ace7-256fe69be320 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:10.119350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 59/127] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:19:09 2022] PUT /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87/users/c8a78ca62f5c4d3896c5e2f1cd4cb186/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:10.125378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4c5db-f730-4b75-88a1-b7a4f3d44b95 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:10.198805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:10.216568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2f0af-5d32-4312-ace7-256fe69be320 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:10.233977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:10.257405 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9753e-603f-49df-b78e-02c398699f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:10.258264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9753e-603f-49df-b78e-02c398699f52 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:10.258793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9753e-603f-49df-b78e-02c398699f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:10.259194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9753e-603f-49df-b78e-02c398699f52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:10.336551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4c5db-f730-4b75-88a1-b7a4f3d44b95 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:10.381816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c12748-ddb6-4690-812c-4986aea23bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:10.382925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c12748-ddb6-4690-812c-4986aea23bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:10.383365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c12748-ddb6-4690-812c-4986aea23bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:10.383767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c12748-ddb6-4690-812c-4986aea23bb6 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:10.385381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c12748-ddb6-4690-812c-4986aea23bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:10.387657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c12748-ddb6-4690-812c-4986aea23bb6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:10.390960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 60/128] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:10 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:10.392710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c12748-ddb6-4690-812c-4986aea23bb6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:10.398244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9753e-603f-49df-b78e-02c398699f52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:10.399673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9753e-603f-49df-b78e-02c398699f52 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:10.522177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c12748-ddb6-4690-812c-4986aea23bb6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:10.525620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:10.563657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80a9be-6668-43f2-94d5-50a6d4cad1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:10.564643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 69/129] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:10.565361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80a9be-6668-43f2-94d5-50a6d4cad1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:10.565846 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80a9be-6668-43f2-94d5-50a6d4cad1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:10.566335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80a9be-6668-43f2-94d5-50a6d4cad1c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:10.569931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9753e-603f-49df-b78e-02c398699f52 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:10.578265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80a9be-6668-43f2-94d5-50a6d4cad1c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9b80a9be-6668-43f2-94d5-50a6d4cad1c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:10.584551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:10.585455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:10.586239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:10.593595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 61/130] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:10.594650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80a9be-6668-43f2-94d5-50a6d4cad1c7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:10.605331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:10.710805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80a9be-6668-43f2-94d5-50a6d4cad1c7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:10.748605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15a2b2-600e-43b6-997d-fbc2162fa19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:10.754392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15a2b2-600e-43b6-997d-fbc2162fa19f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:10.754392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15a2b2-600e-43b6-997d-fbc2162fa19f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:10.754392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15a2b2-600e-43b6-997d-fbc2162fa19f None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:10.756087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15a2b2-600e-43b6-997d-fbc2162fa19f None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:10.757264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15a2b2-600e-43b6-997d-fbc2162fa19f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:10.758942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 62/131] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:10 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:10.762549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15a2b2-600e-43b6-997d-fbc2162fa19f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:10.809488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:10.844303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9753e-603f-49df-b78e-02c398699f52 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:10.908317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184a601-715e-49c2-9a07-8095a012acb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:10.909000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184a601-715e-49c2-9a07-8095a012acb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:10.909302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184a601-715e-49c2-9a07-8095a012acb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:10.909576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184a601-715e-49c2-9a07-8095a012acb6 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87/users/a2a04f508a86457da1ddb1c8676d939d/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:10.913853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184a601-715e-49c2-9a07-8095a012acb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=86802e43046f4a66bdee6d53a4239a87, user_id=a2a04f508a86457da1ddb1c8676d939d, role_id=e24e5dc3a48b4cfdac7a99de5f2f78a7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:10.915312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184a601-715e-49c2-9a07-8095a012acb6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:10.936078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15a2b2-600e-43b6-997d-fbc2162fa19f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:10.973531 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf37418-82e7-4e2a-b95b-1a85f2eb5163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:10.974512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf37418-82e7-4e2a-b95b-1a85f2eb5163 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:10.975027 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf37418-82e7-4e2a-b95b-1a85f2eb5163 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:10.975624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf37418-82e7-4e2a-b95b-1a85f2eb5163 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:10.976578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf37418-82e7-4e2a-b95b-1a85f2eb5163 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:10.977080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf37418-82e7-4e2a-b95b-1a85f2eb5163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:10.979269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf37418-82e7-4e2a-b95b-1a85f2eb5163 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:10.989110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 63/132] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:10.990323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf37418-82e7-4e2a-b95b-1a85f2eb5163 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:11.016372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 70/133] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:19:10 2022] PUT /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87/users/a2a04f508a86457da1ddb1c8676d939d/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:11.017428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184a601-715e-49c2-9a07-8095a012acb6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:11.105628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:11.121690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf37418-82e7-4e2a-b95b-1a85f2eb5163 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:11.210061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:11.212396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665a923-c527-4d0b-9481-740c32a83ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:11.213048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665a923-c527-4d0b-9481-740c32a83ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:11.213357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665a923-c527-4d0b-9481-740c32a83ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:11.213640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665a923-c527-4d0b-9481-740c32a83ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:11.214456 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665a923-c527-4d0b-9481-740c32a83ff8 None admin] RBAC: Adding query filter params (role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6, scope.project.id=86802e43046f4a66bdee6d53a4239a87, user.id=f8db4d19726f45248b4ee6f1db28af5b) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:11.214773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665a923-c527-4d0b-9481-740c32a83ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:11.216231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665a923-c527-4d0b-9481-740c32a83ff8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:11.235249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 64/134] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:10 2022] GET /identity/v3/role_assignments?user.id=f8db4d19726f45248b4ee6f1db28af5b&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:11.282346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184a601-715e-49c2-9a07-8095a012acb6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:11.366056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e67dea-cc3b-4983-b6b8-f38b2e042fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:11.366712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67dea-cc3b-4983-b6b8-f38b2e042fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:11.366998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67dea-cc3b-4983-b6b8-f38b2e042fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:11.367272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67dea-cc3b-4983-b6b8-f38b2e042fe4 None admin] PATH_INFO: `/v3/users/a2a04f508a86457da1ddb1c8676d939d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:11.368727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e67dea-cc3b-4983-b6b8-f38b2e042fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a04f508a86457da1ddb1c8676d939d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:11.370226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e67dea-cc3b-4983-b6b8-f38b2e042fe4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:11.371860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 71/135] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:11 2022] GET /identity/v3/users/a2a04f508a86457da1ddb1c8676d939d => generated 275 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:11.377706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665a923-c527-4d0b-9481-740c32a83ff8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:11.522533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665a923-c527-4d0b-9481-740c32a83ff8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:11.564735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fb39f-2144-46ca-ac6a-437176938969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:11.565428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fb39f-2144-46ca-ac6a-437176938969 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:11.565716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fb39f-2144-46ca-ac6a-437176938969 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:11.565994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fb39f-2144-46ca-ac6a-437176938969 None admin] PATH_INFO: `/v3/projects/32c3ded2af2e402e86f03295baff44ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:11.567191 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fb39f-2144-46ca-ac6a-437176938969 None admin] RBAC: Authorizing `identity:get_project(project_id=32c3ded2af2e402e86f03295baff44ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:11.568656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fb39f-2144-46ca-ac6a-437176938969 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:11.570673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 65/136] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:11 2022] GET /identity/v3/projects/32c3ded2af2e402e86f03295baff44ce => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:11.576833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e67dea-cc3b-4983-b6b8-f38b2e042fe4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:11.813032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e67dea-cc3b-4983-b6b8-f38b2e042fe4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:11.868997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238e492-3dbf-4905-9be9-2139b8b844d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:11.870111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238e492-3dbf-4905-9be9-2139b8b844d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:11.870594 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238e492-3dbf-4905-9be9-2139b8b844d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:11.871065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238e492-3dbf-4905-9be9-2139b8b844d4 None admin] PATH_INFO: `/v3/projects/32c3ded2af2e402e86f03295baff44ce/users/a2a04f508a86457da1ddb1c8676d939d/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:11.873268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238e492-3dbf-4905-9be9-2139b8b844d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=32c3ded2af2e402e86f03295baff44ce, user_id=a2a04f508a86457da1ddb1c8676d939d, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:11.874948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238e492-3dbf-4905-9be9-2139b8b844d4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:11.969815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:11.975475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 72/137] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:19:11 2022] PUT /identity/v3/projects/32c3ded2af2e402e86f03295baff44ce/users/a2a04f508a86457da1ddb1c8676d939d/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:12.204659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36574-2aef-4da9-a25f-dbc2e753841a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:12.205176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36574-2aef-4da9-a25f-dbc2e753841a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:12.205255 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36574-2aef-4da9-a25f-dbc2e753841a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:12.206861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 66/138] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:12.212133 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27570-937e-4f9d-807e-cc91c091c793 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:12.213045 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27570-937e-4f9d-807e-cc91c091c793 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:12.213565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27570-937e-4f9d-807e-cc91c091c793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:12.237239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-67c27570-937e-4f9d-807e-cc91c091c793 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:12.238802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-67c27570-937e-4f9d-807e-cc91c091c793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:12.328057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 73/139] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:12.366015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d1a1d-eca1-4e86-baeb-30cfd412168c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:12.366715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c27570-937e-4f9d-807e-cc91c091c793 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:12.366959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d1a1d-eca1-4e86-baeb-30cfd412168c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:12.367469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d1a1d-eca1-4e86-baeb-30cfd412168c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:12.369006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 67/140] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:12.374741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459037-e7ec-4ee2-b675-b608861f55de None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:12.375283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459037-e7ec-4ee2-b675-b608861f55de None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:12.375757 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459037-e7ec-4ee2-b675-b608861f55de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:12.407261 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-43459037-e7ec-4ee2-b675-b608861f55de None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:12.408879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-43459037-e7ec-4ee2-b675-b608861f55de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:12.427357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:12.528370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c27570-937e-4f9d-807e-cc91c091c793 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:12.548558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 68/141] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 28 05:19:12.580142 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:12.586505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51968620-6256-4d6e-aed9-1301e4bcd473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:12.587410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968620-6256-4d6e-aed9-1301e4bcd473 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:12.587886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968620-6256-4d6e-aed9-1301e4bcd473 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:12.588365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968620-6256-4d6e-aed9-1301e4bcd473 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:12.589816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51968620-6256-4d6e-aed9-1301e4bcd473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:12.595867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51968620-6256-4d6e-aed9-1301e4bcd473 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:12.595867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 74/142] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:12.599387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43459037-e7ec-4ee2-b675-b608861f55de None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:12.633371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51968620-6256-4d6e-aed9-1301e4bcd473 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:12.785170 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43459037-e7ec-4ee2-b675-b608861f55de None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:12.786604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51968620-6256-4d6e-aed9-1301e4bcd473 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:12.822666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb3a93-803c-48c5-ae2b-6aa43ee701c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:12.823652 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb3a93-803c-48c5-ae2b-6aa43ee701c0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:12.824130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb3a93-803c-48c5-ae2b-6aa43ee701c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:12.824594 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb3a93-803c-48c5-ae2b-6aa43ee701c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:12.835970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb3a93-803c-48c5-ae2b-6aa43ee701c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4cdb3a93-803c-48c5-ae2b-6aa43ee701c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:12.841293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:12.842759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:12.843532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:12.846157 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 75/143] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:12.851880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb3a93-803c-48c5-ae2b-6aa43ee701c0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:12.871710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a262bf-8bc2-4353-9e03-2f8dc8ee9c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:12.872785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a262bf-8bc2-4353-9e03-2f8dc8ee9c38 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:12.873901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a262bf-8bc2-4353-9e03-2f8dc8ee9c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:12.876426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a262bf-8bc2-4353-9e03-2f8dc8ee9c38 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:12.877480 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a262bf-8bc2-4353-9e03-2f8dc8ee9c38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:12.879242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a262bf-8bc2-4353-9e03-2f8dc8ee9c38 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:12.942059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:12.984384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb3a93-803c-48c5-ae2b-6aa43ee701c0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:13.017925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:13.022360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 69/144] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:19:12 2022] POST /identity/v3/users => generated 283 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:19:13.024078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e64ff-ce2e-4b81-8f33-5786167cc16f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:13.024375 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e64ff-ce2e-4b81-8f33-5786167cc16f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:13.024943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e64ff-ce2e-4b81-8f33-5786167cc16f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:13.026634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 70/145] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:13.032265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef3ee3-f19e-4192-afef-f140baea6ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:13.032902 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef3ee3-f19e-4192-afef-f140baea6ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:13.033212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef3ee3-f19e-4192-afef-f140baea6ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:13.033491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef3ee3-f19e-4192-afef-f140baea6ca9 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:13.033706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa0ba0-586e-4eba-9837-8686bf80fd4b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:13.033998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa0ba0-586e-4eba-9837-8686bf80fd4b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:13.034236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef3ee3-f19e-4192-afef-f140baea6ca9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:13.034344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa0ba0-586e-4eba-9837-8686bf80fd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:13.034544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef3ee3-f19e-4192-afef-f140baea6ca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:13.036335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef3ee3-f19e-4192-afef-f140baea6ca9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:13.060745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-30aa0ba0-586e-4eba-9837-8686bf80fd4b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:13.060745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-30aa0ba0-586e-4eba-9837-8686bf80fd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:13.061183 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 76/146] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:13.066929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef3ee3-f19e-4192-afef-f140baea6ca9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:13.226831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 71/147] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:13.246431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef3ee3-f19e-4192-afef-f140baea6ca9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:13.264800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa0ba0-586e-4eba-9837-8686bf80fd4b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:13.277203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:13.311453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb2a04-69fd-4310-9067-59a19e899454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:13.313364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2a04-69fd-4310-9067-59a19e899454 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:13.313850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2a04-69fd-4310-9067-59a19e899454 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:13.314334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2a04-69fd-4310-9067-59a19e899454 None admin] PATH_INFO: `/v3/users/a2a04f508a86457da1ddb1c8676d939d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:13.316430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb2a04-69fd-4310-9067-59a19e899454 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a04f508a86457da1ddb1c8676d939d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:13.318192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb2a04-69fd-4310-9067-59a19e899454 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:13.320114 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 77/148] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:13 2022] GET /identity/v3/users/a2a04f508a86457da1ddb1c8676d939d => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:13.327580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb2a04-69fd-4310-9067-59a19e899454 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:13.480994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa0ba0-586e-4eba-9837-8686bf80fd4b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:13.500603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb2a04-69fd-4310-9067-59a19e899454 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:13.532406 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:13.540580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838d0ae-ce97-4305-b39b-adb629769d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:13.541232 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838d0ae-ce97-4305-b39b-adb629769d35 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:13.541515 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838d0ae-ce97-4305-b39b-adb629769d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:13.541790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838d0ae-ce97-4305-b39b-adb629769d35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:13.543718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615f6e4-caf0-4653-a08b-4de15c4b691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:13.544378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615f6e4-caf0-4653-a08b-4de15c4b691e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:13.545356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615f6e4-caf0-4653-a08b-4de15c4b691e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:13.545775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615f6e4-caf0-4653-a08b-4de15c4b691e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:13.571996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615f6e4-caf0-4653-a08b-4de15c4b691e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b615f6e4-caf0-4653-a08b-4de15c4b691e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:13.577512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:13.578381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:13.579715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 72/149] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:19:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:13.584337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615f6e4-caf0-4653-a08b-4de15c4b691e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:13.640203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:13.645975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838d0ae-ce97-4305-b39b-adb629769d35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:13.647555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838d0ae-ce97-4305-b39b-adb629769d35 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:13.759667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 78/150] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:13.765268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838d0ae-ce97-4305-b39b-adb629769d35 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:13.861637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:13.865834 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615f6e4-caf0-4653-a08b-4de15c4b691e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:13.874357 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838d0ae-ce97-4305-b39b-adb629769d35 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:13.910264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6a77f-da3e-4d94-8df7-f1d146dce991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:13.911045 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6a77f-da3e-4d94-8df7-f1d146dce991 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:13.911228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6a77f-da3e-4d94-8df7-f1d146dce991 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:13.911489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6a77f-da3e-4d94-8df7-f1d146dce991 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:13.912666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6a77f-da3e-4d94-8df7-f1d146dce991 None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:13.914169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6a77f-da3e-4d94-8df7-f1d146dce991 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:13.916144 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 79/151] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:13 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:13.922922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6a77f-da3e-4d94-8df7-f1d146dce991 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:13.932831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d55f8-3e9d-4e9a-a62a-38f167d64a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:13.933591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d55f8-3e9d-4e9a-a62a-38f167d64a7a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:13.933936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d55f8-3e9d-4e9a-a62a-38f167d64a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:13.934289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d55f8-3e9d-4e9a-a62a-38f167d64a7a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:13.935075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d55f8-3e9d-4e9a-a62a-38f167d64a7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:13.935526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d55f8-3e9d-4e9a-a62a-38f167d64a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:13.939105 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d55f8-3e9d-4e9a-a62a-38f167d64a7a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:13.948372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 73/152] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:13.954909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d55f8-3e9d-4e9a-a62a-38f167d64a7a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:14.029889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:14.054148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6a77f-da3e-4d94-8df7-f1d146dce991 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:14.083918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d55f8-3e9d-4e9a-a62a-38f167d64a7a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:14.090295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6917e-d23e-4628-9c98-eaceff6da5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:14.090976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6917e-d23e-4628-9c98-eaceff6da5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:14.091259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6917e-d23e-4628-9c98-eaceff6da5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:14.092109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6917e-d23e-4628-9c98-eaceff6da5c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:14.092964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6917e-d23e-4628-9c98-eaceff6da5c7 None admin] RBAC: Adding query filter params (role.id=a21446fa03b24a5ebbaf61a4827146e7, scope.project.id=86802e43046f4a66bdee6d53a4239a87, user.id=a2a04f508a86457da1ddb1c8676d939d) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:14.093301 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6917e-d23e-4628-9c98-eaceff6da5c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:14.094915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6917e-d23e-4628-9c98-eaceff6da5c7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:14.101905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 80/153] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:13 2022] GET /identity/v3/role_assignments?user.id=a2a04f508a86457da1ddb1c8676d939d&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:14.127508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a2b33-201c-4141-93f0-eb9da947f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:14.128278 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2b33-201c-4141-93f0-eb9da947f66c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:14.128657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2b33-201c-4141-93f0-eb9da947f66c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:14.129034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2b33-201c-4141-93f0-eb9da947f66c None admin] PATH_INFO: `/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:14.130594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a2b33-201c-4141-93f0-eb9da947f66c None admin] RBAC: Authorizing `identity:get_user(user_id=c8a78ca62f5c4d3896c5e2f1cd4cb186)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:14.132262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a2b33-201c-4141-93f0-eb9da947f66c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:14.134366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 74/154] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:13 2022] GET /identity/v3/users/c8a78ca62f5c4d3896c5e2f1cd4cb186 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:14.140896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6917e-d23e-4628-9c98-eaceff6da5c7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:14.177549 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:14.283331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6917e-d23e-4628-9c98-eaceff6da5c7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:14.299122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3eca-267a-4f1d-9468-42497aac0685 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:14.300047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3eca-267a-4f1d-9468-42497aac0685 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:14.300513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3eca-267a-4f1d-9468-42497aac0685 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:14.302437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 75/155] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:14.308267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a223-95fb-4a0d-88c8-12f2182fdb3d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:14.308832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a223-95fb-4a0d-88c8-12f2182fdb3d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:14.309323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a223-95fb-4a0d-88c8-12f2182fdb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:14.326673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c482691-05cd-431f-8ca2-4714e570a89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:14.327341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482691-05cd-431f-8ca2-4714e570a89a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:14.327606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482691-05cd-431f-8ca2-4714e570a89a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:14.327875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482691-05cd-431f-8ca2-4714e570a89a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:14.349177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-75b5a223-95fb-4a0d-88c8-12f2182fdb3d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:14.350707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-75b5a223-95fb-4a0d-88c8-12f2182fdb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:14.408599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c482691-05cd-431f-8ca2-4714e570a89a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:14.410177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c482691-05cd-431f-8ca2-4714e570a89a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:14.444058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:14.490847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 76/156] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:14.492825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a7b0-be1f-4631-8465-8fba473d0ae0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:14.493321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a7b0-be1f-4631-8465-8fba473d0ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:14.493798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a7b0-be1f-4631-8465-8fba473d0ae0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:14.495478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 77/157] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:14.510636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf527-e77a-47b8-bb25-812bf01e90a6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:14.511210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf527-e77a-47b8-bb25-812bf01e90a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:14.511662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf527-e77a-47b8-bb25-812bf01e90a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:14.535191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 81/158] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:14.538703 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c482691-05cd-431f-8ca2-4714e570a89a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:14.542772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-273cf527-e77a-47b8-bb25-812bf01e90a6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:14.544226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-273cf527-e77a-47b8-bb25-812bf01e90a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:14.609620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:14.636362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 78/159] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:14.639213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cf527-e77a-47b8-bb25-812bf01e90a6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:14.681917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c482691-05cd-431f-8ca2-4714e570a89a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:14.706926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:14.722183 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05009f-fad2-4c49-bc4f-2c98d958983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:14.723608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05009f-fad2-4c49-bc4f-2c98d958983f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:14.724059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05009f-fad2-4c49-bc4f-2c98d958983f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:14.724484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05009f-fad2-4c49-bc4f-2c98d958983f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:14.736704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05009f-fad2-4c49-bc4f-2c98d958983f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cc05009f-fad2-4c49-bc4f-2c98d958983f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:14.742890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:14.744017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:14.745098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:14.748224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 82/160] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:14.749543 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05009f-fad2-4c49-bc4f-2c98d958983f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:14.849767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cf527-e77a-47b8-bb25-812bf01e90a6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:14.860528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05009f-fad2-4c49-bc4f-2c98d958983f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:14.897858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841e671-0519-41de-a38a-e7b82d2f47d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:14.898775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841e671-0519-41de-a38a-e7b82d2f47d6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:14.899202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841e671-0519-41de-a38a-e7b82d2f47d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:14.899644 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841e671-0519-41de-a38a-e7b82d2f47d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:14.906719 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe4047-b7b9-4850-8d14-fdd7604c2595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:14.907500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe4047-b7b9-4850-8d14-fdd7604c2595 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:14.907879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe4047-b7b9-4850-8d14-fdd7604c2595 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:14.908251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe4047-b7b9-4850-8d14-fdd7604c2595 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:14.909608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe4047-b7b9-4850-8d14-fdd7604c2595 None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:14.911124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe4047-b7b9-4850-8d14-fdd7604c2595 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:14.912641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841e671-0519-41de-a38a-e7b82d2f47d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:14.912993 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 79/161] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:14 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:14.913782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe4047-b7b9-4850-8d14-fdd7604c2595 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6841e671-0519-41de-a38a-e7b82d2f47d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:14.918417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:14.919326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:14.920763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:14.923375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 83/162] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:14.924466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841e671-0519-41de-a38a-e7b82d2f47d6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:14.997571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:15.011813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:15.034341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841e671-0519-41de-a38a-e7b82d2f47d6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:15.075482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a2209-d9cb-464d-abcc-f6de62a858b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:15.079589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a2209-d9cb-464d-abcc-f6de62a858b6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:15.080137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a2209-d9cb-464d-abcc-f6de62a858b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:15.080614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a2209-d9cb-464d-abcc-f6de62a858b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:15.081668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a2209-d9cb-464d-abcc-f6de62a858b6 None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=86802e43046f4a66bdee6d53a4239a87, user.id=c8a78ca62f5c4d3896c5e2f1cd4cb186) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:15.083227 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a2209-d9cb-464d-abcc-f6de62a858b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:15.085190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a2209-d9cb-464d-abcc-f6de62a858b6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:15.097528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 84/163] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:14 2022] GET /identity/v3/role_assignments?user.id=c8a78ca62f5c4d3896c5e2f1cd4cb186&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=57a86ff4c9de433399662eebf6893065 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:15.099424 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a2209-d9cb-464d-abcc-f6de62a858b6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:15.114327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe4047-b7b9-4850-8d14-fdd7604c2595 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:15.187056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aeaef-dac2-42a4-9cd3-6255f6961cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:15.187707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aeaef-dac2-42a4-9cd3-6255f6961cfe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:15.187988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aeaef-dac2-42a4-9cd3-6255f6961cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:15.188364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aeaef-dac2-42a4-9cd3-6255f6961cfe None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:15.189108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4aeaef-dac2-42a4-9cd3-6255f6961cfe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:15.189561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4aeaef-dac2-42a4-9cd3-6255f6961cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:15.191011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4aeaef-dac2-42a4-9cd3-6255f6961cfe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:15.215425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 80/164] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:15.222294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aeaef-dac2-42a4-9cd3-6255f6961cfe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:15.251114 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a2209-d9cb-464d-abcc-f6de62a858b6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:15.253820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:15.289522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd398ac-b48b-4b61-b9ad-0e80b1fa5406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:15.290301 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd398ac-b48b-4b61-b9ad-0e80b1fa5406 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:15.290566 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd398ac-b48b-4b61-b9ad-0e80b1fa5406 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:15.290845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd398ac-b48b-4b61-b9ad-0e80b1fa5406 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:15.291676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd398ac-b48b-4b61-b9ad-0e80b1fa5406 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:15.292012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd398ac-b48b-4b61-b9ad-0e80b1fa5406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:15.293433 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd398ac-b48b-4b61-b9ad-0e80b1fa5406 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:15.303570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 85/165] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:15.309382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd398ac-b48b-4b61-b9ad-0e80b1fa5406 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:15.463246 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd398ac-b48b-4b61-b9ad-0e80b1fa5406 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:15.512427 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e233c-0ab4-4047-81c4-95e5bb4d5272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:15.513148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e233c-0ab4-4047-81c4-95e5bb4d5272 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:15.514020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e233c-0ab4-4047-81c4-95e5bb4d5272 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:15.514499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e233c-0ab4-4047-81c4-95e5bb4d5272 None admin] PATH_INFO: `/v3/users/f8db4d19726f45248b4ee6f1db28af5b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:15.515724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e233c-0ab4-4047-81c4-95e5bb4d5272 None admin] RBAC: Authorizing `identity:get_user(user_id=f8db4d19726f45248b4ee6f1db28af5b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:15.519470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e233c-0ab4-4047-81c4-95e5bb4d5272 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:15.521569 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 86/166] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:15 2022] GET /identity/v3/users/f8db4d19726f45248b4ee6f1db28af5b => generated 289 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:15.527037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e233c-0ab4-4047-81c4-95e5bb4d5272 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:15.539324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aeaef-dac2-42a4-9cd3-6255f6961cfe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:15.561891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:15.567567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:15.613880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac2f3-9c92-48f6-8244-9a2d19cbd0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:15.614550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac2f3-9c92-48f6-8244-9a2d19cbd0cd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:15.614833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac2f3-9c92-48f6-8244-9a2d19cbd0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:15.615112 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac2f3-9c92-48f6-8244-9a2d19cbd0cd None admin] PATH_INFO: `/v3/users/a2a04f508a86457da1ddb1c8676d939d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:15.616369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdac2f3-9c92-48f6-8244-9a2d19cbd0cd None admin] RBAC: Authorizing `identity:get_user(user_id=a2a04f508a86457da1ddb1c8676d939d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:15.617849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdac2f3-9c92-48f6-8244-9a2d19cbd0cd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:15.619781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 81/167] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:15 2022] GET /identity/v3/users/a2a04f508a86457da1ddb1c8676d939d => generated 275 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:15.625632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac2f3-9c92-48f6-8244-9a2d19cbd0cd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:15.636570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e233c-0ab4-4047-81c4-95e5bb4d5272 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:15.677372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6942c5-3bdb-4dff-8bd4-8a137d10526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:15.678031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6942c5-3bdb-4dff-8bd4-8a137d10526f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:15.678419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6942c5-3bdb-4dff-8bd4-8a137d10526f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:15.678701 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6942c5-3bdb-4dff-8bd4-8a137d10526f None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:15.681252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6942c5-3bdb-4dff-8bd4-8a137d10526f None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:15.682717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6942c5-3bdb-4dff-8bd4-8a137d10526f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:15.684648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 87/168] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:15 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:15.690525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6942c5-3bdb-4dff-8bd4-8a137d10526f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:15.775391 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac2f3-9c92-48f6-8244-9a2d19cbd0cd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:15.802375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6942c5-3bdb-4dff-8bd4-8a137d10526f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:15.805533 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:15.829855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089929a8-fdc7-41a8-86d6-ac03e5664329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:15.830501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089929a8-fdc7-41a8-86d6-ac03e5664329 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:15.830789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089929a8-fdc7-41a8-86d6-ac03e5664329 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:15.831069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089929a8-fdc7-41a8-86d6-ac03e5664329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:15.844081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9502a-fa75-4e1e-9136-44b648e5f2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:15.844918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9502a-fa75-4e1e-9136-44b648e5f2c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:15.845272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9502a-fa75-4e1e-9136-44b648e5f2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:15.845552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9502a-fa75-4e1e-9136-44b648e5f2c2 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87/users/f8db4d19726f45248b4ee6f1db28af5b/roles/a1a15b7daf9f4fa697a9d35e7ce7dab6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:15.847657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9502a-fa75-4e1e-9136-44b648e5f2c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=86802e43046f4a66bdee6d53a4239a87, user_id=f8db4d19726f45248b4ee6f1db28af5b, role_id=a1a15b7daf9f4fa697a9d35e7ce7dab6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:15.849294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9502a-fa75-4e1e-9136-44b648e5f2c2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:15.887732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:15.912779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089929a8-fdc7-41a8-86d6-ac03e5664329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:15.914363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089929a8-fdc7-41a8-86d6-ac03e5664329 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:15.947194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 88/169] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:19:15 2022] PUT /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87/users/f8db4d19726f45248b4ee6f1db28af5b/roles/a1a15b7daf9f4fa697a9d35e7ce7dab6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:19:15.986803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200dd2-be8b-42b0-a2a9-11ba8c7eb3bb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:15.987130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200dd2-be8b-42b0-a2a9-11ba8c7eb3bb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:15.987413 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200dd2-be8b-42b0-a2a9-11ba8c7eb3bb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:15.989000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 89/170] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:15.995144 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95809-3fa6-467a-974d-e5dd77aa068f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:15.995481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95809-3fa6-467a-974d-e5dd77aa068f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:15.995760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95809-3fa6-467a-974d-e5dd77aa068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:16.028548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-def95809-3fa6-467a-974d-e5dd77aa068f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:16.033236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-def95809-3fa6-467a-974d-e5dd77aa068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:16.102169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 82/171] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:19:16.108811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089929a8-fdc7-41a8-86d6-ac03e5664329 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:16.140824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 90/172] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:16.171822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def95809-3fa6-467a-974d-e5dd77aa068f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:16.287761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:16.298130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def95809-3fa6-467a-974d-e5dd77aa068f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:16.300958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:16.343500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089929a8-fdc7-41a8-86d6-ac03e5664329 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:16.345630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13293ac7-fa5e-47ec-a283-fd6429780264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:16.352396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13293ac7-fa5e-47ec-a283-fd6429780264 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:16.352396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13293ac7-fa5e-47ec-a283-fd6429780264 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:16.352396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13293ac7-fa5e-47ec-a283-fd6429780264 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:16.366027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13293ac7-fa5e-47ec-a283-fd6429780264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-13293ac7-fa5e-47ec-a283-fd6429780264 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:16.371348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:16.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:16.373447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:16.383699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 91/173] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:16.383927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40598e5f-c605-4b57-9b4d-e2f27269fdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:16.384545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40598e5f-c605-4b57-9b4d-e2f27269fdbe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:16.384827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40598e5f-c605-4b57-9b4d-e2f27269fdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:16.385103 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40598e5f-c605-4b57-9b4d-e2f27269fdbe None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:16.390506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40598e5f-c605-4b57-9b4d-e2f27269fdbe None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:16.392025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40598e5f-c605-4b57-9b4d-e2f27269fdbe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:16.394107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 83/174] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:16 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:16.396384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13293ac7-fa5e-47ec-a283-fd6429780264 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:16.402581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40598e5f-c605-4b57-9b4d-e2f27269fdbe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:16.670402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13293ac7-fa5e-47ec-a283-fd6429780264 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:16.670626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40598e5f-c605-4b57-9b4d-e2f27269fdbe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:16.738796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b6ba3-29c5-4d22-a61b-fcbbfffea7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:16.739551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b6ba3-29c5-4d22-a61b-fcbbfffea7cc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:16.739896 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b6ba3-29c5-4d22-a61b-fcbbfffea7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:16.740238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b6ba3-29c5-4d22-a61b-fcbbfffea7cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:16.741112 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b6ba3-29c5-4d22-a61b-fcbbfffea7cc None admin] RBAC: Adding query filter params (role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7, scope.project.id=86802e43046f4a66bdee6d53a4239a87, user.id=a2a04f508a86457da1ddb1c8676d939d) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:16.741642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b6ba3-29c5-4d22-a61b-fcbbfffea7cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:16.743178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b6ba3-29c5-4d22-a61b-fcbbfffea7cc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:16.745689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683a0e5-975f-4ffa-87b0-71eab50425ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:16.747173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683a0e5-975f-4ffa-87b0-71eab50425ec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:16.748231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683a0e5-975f-4ffa-87b0-71eab50425ec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:16.748708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683a0e5-975f-4ffa-87b0-71eab50425ec None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:16.749865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683a0e5-975f-4ffa-87b0-71eab50425ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:16.750539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683a0e5-975f-4ffa-87b0-71eab50425ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:16.752164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683a0e5-975f-4ffa-87b0-71eab50425ec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:16.760671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 84/175] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:16 2022] GET /identity/v3/role_assignments?user.id=a2a04f508a86457da1ddb1c8676d939d&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 608 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:16.763967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 92/176] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:16.769781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b6ba3-29c5-4d22-a61b-fcbbfffea7cc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:16.787032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:16.915418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b6ba3-29c5-4d22-a61b-fcbbfffea7cc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:16.966823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03621c-1592-4eac-8bf6-de1c8626dc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:16.967681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03621c-1592-4eac-8bf6-de1c8626dc5e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:16.968049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03621c-1592-4eac-8bf6-de1c8626dc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:16.968324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03621c-1592-4eac-8bf6-de1c8626dc5e None admin] PATH_INFO: `/v3/users/a2a04f508a86457da1ddb1c8676d939d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:16.973946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03621c-1592-4eac-8bf6-de1c8626dc5e None admin] RBAC: Authorizing `identity:get_user(user_id=a2a04f508a86457da1ddb1c8676d939d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:16.975427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03621c-1592-4eac-8bf6-de1c8626dc5e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:16.977095 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 85/177] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:16 2022] GET /identity/v3/users/a2a04f508a86457da1ddb1c8676d939d => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:16.986296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683a0e5-975f-4ffa-87b0-71eab50425ec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:17.004283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fe2d9-f0ff-4ff8-87db-3fba1b413772 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:17.004601 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fe2d9-f0ff-4ff8-87db-3fba1b413772 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:17.004848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fe2d9-f0ff-4ff8-87db-3fba1b413772 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:17.006279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 86/178] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:17.009965 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:17.022788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8fcd3-ba91-4140-bcff-82a987f955a2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:17.023115 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8fcd3-ba91-4140-bcff-82a987f955a2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:17.023347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8fcd3-ba91-4140-bcff-82a987f955a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:17.066262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2ac8fcd3-ba91-4140-bcff-82a987f955a2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:17.067499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ac8fcd3-ba91-4140-bcff-82a987f955a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:17.172115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683a0e5-975f-4ffa-87b0-71eab50425ec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:17.225169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 87/179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:17.239198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af707c-08a8-4801-9944-db5f3e2542ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:17.239828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af707c-08a8-4801-9944-db5f3e2542ad None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:17.240111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af707c-08a8-4801-9944-db5f3e2542ad None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:17.240466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af707c-08a8-4801-9944-db5f3e2542ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:17.249523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8fcd3-ba91-4140-bcff-82a987f955a2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:17.259915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:17.350244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af707c-08a8-4801-9944-db5f3e2542ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:17.352249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af707c-08a8-4801-9944-db5f3e2542ad None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:17.363365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8fcd3-ba91-4140-bcff-82a987f955a2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:17.370162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:17.412023 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d9c22-9b1a-4c45-986f-0a2961e4e5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:17.413120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d9c22-9b1a-4c45-986f-0a2961e4e5dc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:17.413427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d9c22-9b1a-4c45-986f-0a2961e4e5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:17.413699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d9c22-9b1a-4c45-986f-0a2961e4e5dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:17.427841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d9c22-9b1a-4c45-986f-0a2961e4e5dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a86d9c22-9b1a-4c45-986f-0a2961e4e5dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:17.434908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:17.436801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 88/180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:19:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:17.445936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8db76-9a1e-43c4-b72c-34f9cacb362c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:17.446735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8db76-9a1e-43c4-b72c-34f9cacb362c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:17.446735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8db76-9a1e-43c4-b72c-34f9cacb362c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:17.446735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 89/181] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:17.448952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8db76-9a1e-43c4-b72c-34f9cacb362c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:17.482504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 93/182] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:17.482504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384210-13ae-4116-8276-34a0cfb3760d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:17.482504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384210-13ae-4116-8276-34a0cfb3760d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:17.482504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95384210-13ae-4116-8276-34a0cfb3760d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:17.507512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-95384210-13ae-4116-8276-34a0cfb3760d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:17.508770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-95384210-13ae-4116-8276-34a0cfb3760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:17.530266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:17.587305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8db76-9a1e-43c4-b72c-34f9cacb362c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:17.588726 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 94/183] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:17.589643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95384210-13ae-4116-8276-34a0cfb3760d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:17.646545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfec26-98dd-4ed7-b7c3-fc732a4604db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:17.647576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfec26-98dd-4ed7-b7c3-fc732a4604db None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:17.648129 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfec26-98dd-4ed7-b7c3-fc732a4604db None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:17.648407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfec26-98dd-4ed7-b7c3-fc732a4604db None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:17.649148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfec26-98dd-4ed7-b7c3-fc732a4604db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:17.649714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:17.650625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfec26-98dd-4ed7-b7c3-fc732a4604db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:17.652927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfec26-98dd-4ed7-b7c3-fc732a4604db None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:17.664269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 90/184] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:17.665419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfec26-98dd-4ed7-b7c3-fc732a4604db None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:17.714056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95384210-13ae-4116-8276-34a0cfb3760d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:17.753416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f315c-f05d-46c5-a697-e456d18b0b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:17.754030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f315c-f05d-46c5-a697-e456d18b0b84 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:17.754306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f315c-f05d-46c5-a697-e456d18b0b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:17.754571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f315c-f05d-46c5-a697-e456d18b0b84 None admin] PATH_INFO: `/v3/projects/32c3ded2af2e402e86f03295baff44ce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:17.755720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f315c-f05d-46c5-a697-e456d18b0b84 None admin] RBAC: Authorizing `identity:get_project(project_id=32c3ded2af2e402e86f03295baff44ce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:17.757681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f315c-f05d-46c5-a697-e456d18b0b84 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:17.765418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 95/185] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:17 2022] GET /identity/v3/projects/32c3ded2af2e402e86f03295baff44ce => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:17.765418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f315c-f05d-46c5-a697-e456d18b0b84 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:17.782924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfec26-98dd-4ed7-b7c3-fc732a4604db None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:17.812637 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:17.818437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035995d5-01f3-468b-9afd-7e285a3a1573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:17.819071 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035995d5-01f3-468b-9afd-7e285a3a1573 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:17.819346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035995d5-01f3-468b-9afd-7e285a3a1573 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:17.819610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035995d5-01f3-468b-9afd-7e285a3a1573 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:17.830773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035995d5-01f3-468b-9afd-7e285a3a1573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-035995d5-01f3-468b-9afd-7e285a3a1573 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:17.835607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:17.836502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:17.837321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:17.842266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 91/186] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:17.843599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade65d-74d5-42c9-9109-e4f0edf42ec3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:17.843895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade65d-74d5-42c9-9109-e4f0edf42ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:17.844457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade65d-74d5-42c9-9109-e4f0edf42ec3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:17.846154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 92/187] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:17.851157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade65d-74d5-42c9-9109-e4f0edf42ec3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:17.874385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f315c-f05d-46c5-a697-e456d18b0b84 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:17.889410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:17.914565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039303c6-33c8-4e7a-a781-f84881a0f1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:17.915227 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039303c6-33c8-4e7a-a781-f84881a0f1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:17.915895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039303c6-33c8-4e7a-a781-f84881a0f1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:17.916512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039303c6-33c8-4e7a-a781-f84881a0f1b4 None admin] PATH_INFO: `/v3/users/eba8b729574d481c8256ea8a0b4c11c7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:17.935888 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039303c6-33c8-4e7a-a781-f84881a0f1b4 None admin] RBAC: Authorizing `identity:get_user(user_id=eba8b729574d481c8256ea8a0b4c11c7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:17.937398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039303c6-33c8-4e7a-a781-f84881a0f1b4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:17.939257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 96/188] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:17 2022] GET /identity/v3/users/eba8b729574d481c8256ea8a0b4c11c7 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:17.939838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039303c6-33c8-4e7a-a781-f84881a0f1b4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:17.966032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade65d-74d5-42c9-9109-e4f0edf42ec3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:18.002499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e50d1-fa5f-4c76-95c1-3679f52e3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:18.003117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e50d1-fa5f-4c76-95c1-3679f52e3f0b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.003393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e50d1-fa5f-4c76-95c1-3679f52e3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.003714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e50d1-fa5f-4c76-95c1-3679f52e3f0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:18.004441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e50d1-fa5f-4c76-95c1-3679f52e3f0b None admin] RBAC: Adding query filter params (role.id=a21446fa03b24a5ebbaf61a4827146e7, scope.project.id=32c3ded2af2e402e86f03295baff44ce, user.id=a2a04f508a86457da1ddb1c8676d939d) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:18.004744 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e50d1-fa5f-4c76-95c1-3679f52e3f0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:18.006222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e50d1-fa5f-4c76-95c1-3679f52e3f0b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:18.017167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 93/189] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:17 2022] GET /identity/v3/role_assignments?user.id=a2a04f508a86457da1ddb1c8676d939d&scope.project.id=32c3ded2af2e402e86f03295baff44ce&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:18.017167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9052-0a1d-4fda-bb04-89c7f31b7fb2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.017167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9052-0a1d-4fda-bb04-89c7f31b7fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.017167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9052-0a1d-4fda-bb04-89c7f31b7fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:18.034799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-911f9052-0a1d-4fda-bb04-89c7f31b7fb2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:18.036012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-911f9052-0a1d-4fda-bb04-89c7f31b7fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:18.067480 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039303c6-33c8-4e7a-a781-f84881a0f1b4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:18.099240 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:18.117275 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd6f09-700d-4b03-ad8f-05e5b81ca1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:18.117913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd6f09-700d-4b03-ad8f-05e5b81ca1de None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.118236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd6f09-700d-4b03-ad8f-05e5b81ca1de None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.118538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd6f09-700d-4b03-ad8f-05e5b81ca1de None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:18.119692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd6f09-700d-4b03-ad8f-05e5b81ca1de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:18.120001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd6f09-700d-4b03-ad8f-05e5b81ca1de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:18.121091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 94/190] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:18.122004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f9052-0a1d-4fda-bb04-89c7f31b7fb2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:18.126140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd6f09-700d-4b03-ad8f-05e5b81ca1de None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:18.144926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 97/191] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:18.152217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd6f09-700d-4b03-ad8f-05e5b81ca1de None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:18.193081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:18.256930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f9052-0a1d-4fda-bb04-89c7f31b7fb2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:18.280394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd6f09-700d-4b03-ad8f-05e5b81ca1de None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:18.303254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d801f12-c891-4897-9c7a-9efd87f3aa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:18.303254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d801f12-c891-4897-9c7a-9efd87f3aa62 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.303254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d801f12-c891-4897-9c7a-9efd87f3aa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.303254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d801f12-c891-4897-9c7a-9efd87f3aa62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:18.326165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47053756-4ac3-474e-a483-c96e27e0c605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:18.326818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47053756-4ac3-474e-a483-c96e27e0c605 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.327099 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47053756-4ac3-474e-a483-c96e27e0c605 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.327372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47053756-4ac3-474e-a483-c96e27e0c605 None admin] PATH_INFO: `/v3/users/eba8b729574d481c8256ea8a0b4c11c7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:18.329010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47053756-4ac3-474e-a483-c96e27e0c605 None admin] RBAC: Authorizing `identity:get_user(user_id=eba8b729574d481c8256ea8a0b4c11c7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:18.330541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47053756-4ac3-474e-a483-c96e27e0c605 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:18.332317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 98/192] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:18 2022] GET /identity/v3/users/eba8b729574d481c8256ea8a0b4c11c7 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:18.332907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47053756-4ac3-474e-a483-c96e27e0c605 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:18.365172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:18.380909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d801f12-c891-4897-9c7a-9efd87f3aa62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:18.382514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d801f12-c891-4897-9c7a-9efd87f3aa62 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:18.440438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:18.444293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47053756-4ac3-474e-a483-c96e27e0c605 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:18.480522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc267c-ea05-4608-8e8c-559c84ffddf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:18.481294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc267c-ea05-4608-8e8c-559c84ffddf5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.481573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc267c-ea05-4608-8e8c-559c84ffddf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.481917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc267c-ea05-4608-8e8c-559c84ffddf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:18.483638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc267c-ea05-4608-8e8c-559c84ffddf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:18.485197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc267c-ea05-4608-8e8c-559c84ffddf5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:18.491716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 95/193] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:18.491716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d801f12-c891-4897-9c7a-9efd87f3aa62 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:18.493474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 99/194] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:18.494851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc267c-ea05-4608-8e8c-559c84ffddf5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:18.573817 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:18.588732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d801f12-c891-4897-9c7a-9efd87f3aa62 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:18.593969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc267c-ea05-4608-8e8c-559c84ffddf5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:18.624031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ebd5a-072a-4a79-801a-f39227b11d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:18.624643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ebd5a-072a-4a79-801a-f39227b11d36 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.624921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ebd5a-072a-4a79-801a-f39227b11d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.625216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ebd5a-072a-4a79-801a-f39227b11d36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:18.627128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41aadb-d3fd-4e1b-9229-5524d7f9ae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:18.627739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41aadb-d3fd-4e1b-9229-5524d7f9ae86 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.628018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41aadb-d3fd-4e1b-9229-5524d7f9ae86 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.628283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41aadb-d3fd-4e1b-9229-5524d7f9ae86 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:18.628966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41aadb-d3fd-4e1b-9229-5524d7f9ae86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:18.630454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41aadb-d3fd-4e1b-9229-5524d7f9ae86 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:18.692158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ebd5a-072a-4a79-801a-f39227b11d36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:18.693642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ebd5a-072a-4a79-801a-f39227b11d36 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:18.718685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 100/195] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:19:18 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:19:18.719509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41aadb-d3fd-4e1b-9229-5524d7f9ae86 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:18.749797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:18.797034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:18.815954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 96/196] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:18.817542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ae07-7b53-40e4-847d-89ec56a1493b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.818036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ae07-7b53-40e4-847d-89ec56a1493b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.818524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ae07-7b53-40e4-847d-89ec56a1493b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:18.820022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 97/197] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:18.821716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2ae07-7b53-40e4-847d-89ec56a1493b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:18.842554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41aadb-d3fd-4e1b-9229-5524d7f9ae86 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:18.885339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131ed81-cb20-4cd1-b4c0-3fc925afbce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:18.885994 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ed81-cb20-4cd1-b4c0-3fc925afbce7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.886277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ed81-cb20-4cd1-b4c0-3fc925afbce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.886551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ed81-cb20-4cd1-b4c0-3fc925afbce7 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:18.887731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131ed81-cb20-4cd1-b4c0-3fc925afbce7 None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:18.889722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131ed81-cb20-4cd1-b4c0-3fc925afbce7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:18.891400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 101/198] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:18 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:18.892548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4cb0-2a85-4fe5-805b-24408f5894d8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.892814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4cb0-2a85-4fe5-805b-24408f5894d8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.893090 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4cb0-2a85-4fe5-805b-24408f5894d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:18.912307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-210e4cb0-2a85-4fe5-805b-24408f5894d8 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:18.913529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-210e4cb0-2a85-4fe5-805b-24408f5894d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:18.952801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2ae07-7b53-40e4-847d-89ec56a1493b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:18.996683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c311-82cc-4441-969f-9edc226316e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:18.998490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c311-82cc-4441-969f-9edc226316e3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:18.999202 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c311-82cc-4441-969f-9edc226316e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:18.999673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c311-82cc-4441-969f-9edc226316e3 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:19.000697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 102/199] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:19.001506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4cb0-2a85-4fe5-805b-24408f5894d8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:19.002386 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c311-82cc-4441-969f-9edc226316e3 None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:19.004676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c311-82cc-4441-969f-9edc226316e3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:19.006927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 98/200] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:18 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:19.014786 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c311-82cc-4441-969f-9edc226316e3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:19.036755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:19.090551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:19.135579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4cb0-2a85-4fe5-805b-24408f5894d8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:19.145361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c311-82cc-4441-969f-9edc226316e3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:19.186075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f1d70-dabe-4900-8fa4-bb65180d1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:19.187047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1d70-dabe-4900-8fa4-bb65180d1e0e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:19.187272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444859-11ee-4ade-a62d-e251ef96e11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:19.187389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1d70-dabe-4900-8fa4-bb65180d1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:19.187749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1d70-dabe-4900-8fa4-bb65180d1e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:19.187895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444859-11ee-4ade-a62d-e251ef96e11c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:19.188181 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444859-11ee-4ade-a62d-e251ef96e11c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:19.188455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444859-11ee-4ade-a62d-e251ef96e11c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:19.188821 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f1d70-dabe-4900-8fa4-bb65180d1e0e None admin] RBAC: Adding query filter params (role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7, scope.project.id=4fd381b007244ca79e5e671f37551f9a, user.id=eba8b729574d481c8256ea8a0b4c11c7) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:19.189230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f1d70-dabe-4900-8fa4-bb65180d1e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:19.189329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6444859-11ee-4ade-a62d-e251ef96e11c None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=4fd381b007244ca79e5e671f37551f9a, user.id=eba8b729574d481c8256ea8a0b4c11c7) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:19.189579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6444859-11ee-4ade-a62d-e251ef96e11c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:19.190847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f1d70-dabe-4900-8fa4-bb65180d1e0e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:19.191018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6444859-11ee-4ade-a62d-e251ef96e11c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:19.197064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 103/201] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:19 2022] GET /identity/v3/role_assignments?user.id=eba8b729574d481c8256ea8a0b4c11c7&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=57a86ff4c9de433399662eebf6893065 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:19.197912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444859-11ee-4ade-a62d-e251ef96e11c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:19.198573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 99/202] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:19 2022] GET /identity/v3/role_assignments?user.id=eba8b729574d481c8256ea8a0b4c11c7&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:19.308149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:19.329460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444859-11ee-4ade-a62d-e251ef96e11c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:19.376873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a63d-7f7e-4c54-a8ab-e8d87d949b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:19.377574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a63d-7f7e-4c54-a8ab-e8d87d949b71 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:19.377856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a63d-7f7e-4c54-a8ab-e8d87d949b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:19.378132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a63d-7f7e-4c54-a8ab-e8d87d949b71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:19.393366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5a63d-7f7e-4c54-a8ab-e8d87d949b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-40d5a63d-7f7e-4c54-a8ab-e8d87d949b71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:19.398931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:19.399866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:19.400654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 104/203] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:19.406949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f1d70-dabe-4900-8fa4-bb65180d1e0e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:19.528696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f1d70-dabe-4900-8fa4-bb65180d1e0e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:19.596239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:19.619841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b067673-692b-4d2b-a0d4-22519a0612a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:19.620492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067673-692b-4d2b-a0d4-22519a0612a6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:19.620827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067673-692b-4d2b-a0d4-22519a0612a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:19.621165 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067673-692b-4d2b-a0d4-22519a0612a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:19.621911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b067673-692b-4d2b-a0d4-22519a0612a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:19.622216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b067673-692b-4d2b-a0d4-22519a0612a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:19.624931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b067673-692b-4d2b-a0d4-22519a0612a6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:19.639769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 100/204] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:19.641116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a63d-7f7e-4c54-a8ab-e8d87d949b71 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:19.755393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a63d-7f7e-4c54-a8ab-e8d87d949b71 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:19.794277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c014e-30e7-42a9-84a3-3f4a6001c0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:19.794938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c014e-30e7-42a9-84a3-3f4a6001c0bc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:19.795223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c014e-30e7-42a9-84a3-3f4a6001c0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:19.795499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c014e-30e7-42a9-84a3-3f4a6001c0bc None admin] PATH_INFO: `/v3/users/f8db4d19726f45248b4ee6f1db28af5b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:19.796679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c014e-30e7-42a9-84a3-3f4a6001c0bc None admin] RBAC: Authorizing `identity:get_user(user_id=f8db4d19726f45248b4ee6f1db28af5b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:19.798165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c014e-30e7-42a9-84a3-3f4a6001c0bc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:19.799773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 105/205] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:19 2022] GET /identity/v3/users/f8db4d19726f45248b4ee6f1db28af5b => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:19.806296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b067673-692b-4d2b-a0d4-22519a0612a6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:19.920513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b067673-692b-4d2b-a0d4-22519a0612a6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:19.964751 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fca7e7-ea56-42e8-a2ba-57cb6204ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:19.965742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fca7e7-ea56-42e8-a2ba-57cb6204ea4a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:19.966253 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fca7e7-ea56-42e8-a2ba-57cb6204ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:19.966758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fca7e7-ea56-42e8-a2ba-57cb6204ea4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:20.017095 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:20.039451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fca7e7-ea56-42e8-a2ba-57cb6204ea4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:20.041233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fca7e7-ea56-42e8-a2ba-57cb6204ea4a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:20.164482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 101/206] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:20.173915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c014e-30e7-42a9-84a3-3f4a6001c0bc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:20.197557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:20.344015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c014e-30e7-42a9-84a3-3f4a6001c0bc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:20.394346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b693ab-c338-4f05-886a-236105bfaa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:20.394992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b693ab-c338-4f05-886a-236105bfaa2b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:20.395268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b693ab-c338-4f05-886a-236105bfaa2b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:20.395544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b693ab-c338-4f05-886a-236105bfaa2b None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:20.396718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b693ab-c338-4f05-886a-236105bfaa2b None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:20.398206 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b693ab-c338-4f05-886a-236105bfaa2b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:20.399858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 106/207] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:20 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:20.406408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fca7e7-ea56-42e8-a2ba-57cb6204ea4a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:20.505782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:20.526965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fca7e7-ea56-42e8-a2ba-57cb6204ea4a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:20.562485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671ec93-2fa5-4294-a5ed-7d83de107f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:20.563432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671ec93-2fa5-4294-a5ed-7d83de107f4a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:20.563930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671ec93-2fa5-4294-a5ed-7d83de107f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:20.564395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671ec93-2fa5-4294-a5ed-7d83de107f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:20.565392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671ec93-2fa5-4294-a5ed-7d83de107f4a None admin] RBAC: Adding query filter params (role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6, scope.project.id=86802e43046f4a66bdee6d53a4239a87, user.id=f8db4d19726f45248b4ee6f1db28af5b) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:20.565895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671ec93-2fa5-4294-a5ed-7d83de107f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:20.567521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671ec93-2fa5-4294-a5ed-7d83de107f4a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:20.573655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 102/208] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:20 2022] GET /identity/v3/role_assignments?user.id=f8db4d19726f45248b4ee6f1db28af5b&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:21.260386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f40818-e58f-466a-980c-0cbd3f9ab0a0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.260871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f40818-e58f-466a-980c-0cbd3f9ab0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.260944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f40818-e58f-466a-980c-0cbd3f9ab0a0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.262598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 107/209] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:21.268019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532dad0-70e1-4afb-814e-e67ae5419cd1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.268440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532dad0-70e1-4afb-814e-e67ae5419cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.268619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532dad0-70e1-4afb-814e-e67ae5419cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.289275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2532dad0-70e1-4afb-814e-e67ae5419cd1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:21.290807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2532dad0-70e1-4afb-814e-e67ae5419cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:21.361591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 103/210] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:21.385034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f40818-e58f-466a-980c-0cbd3f9ab0a0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:21.401256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82b882-6c03-4c99-a702-9bd054c7ddab None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.401886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82b882-6c03-4c99-a702-9bd054c7ddab None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.402350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82b882-6c03-4c99-a702-9bd054c7ddab None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.403936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 104/211] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:21.409783 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e65c6d-7a2e-4dbd-8f79-0630af94f1a8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.410145 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e65c6d-7a2e-4dbd-8f79-0630af94f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.410334 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e65c6d-7a2e-4dbd-8f79-0630af94f1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.432938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-86e65c6d-7a2e-4dbd-8f79-0630af94f1a8 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:21.432938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-86e65c6d-7a2e-4dbd-8f79-0630af94f1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:21.492820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:21.513837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f40818-e58f-466a-980c-0cbd3f9ab0a0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:21.518388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 105/212] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:21.547992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e65c6d-7a2e-4dbd-8f79-0630af94f1a8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:21.555208 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af0d22-9aff-450e-a898-6e22216e24a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:21.556142 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af0d22-9aff-450e-a898-6e22216e24a0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.557037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af0d22-9aff-450e-a898-6e22216e24a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.557553 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af0d22-9aff-450e-a898-6e22216e24a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.559110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:21.572712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af0d22-9aff-450e-a898-6e22216e24a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a9af0d22-9aff-450e-a898-6e22216e24a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:21.580630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:21.581557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:21.582501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 108/213] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:21.588105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af0d22-9aff-450e-a898-6e22216e24a0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:21.661861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e65c6d-7a2e-4dbd-8f79-0630af94f1a8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:21.696141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af0d22-9aff-450e-a898-6e22216e24a0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:21.696951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc29b4-9ce3-4b84-b66e-1f6cc68d717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:21.697636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc29b4-9ce3-4b84-b66e-1f6cc68d717b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.697919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc29b4-9ce3-4b84-b66e-1f6cc68d717b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.698193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc29b4-9ce3-4b84-b66e-1f6cc68d717b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.699343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc29b4-9ce3-4b84-b66e-1f6cc68d717b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:21.701610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc29b4-9ce3-4b84-b66e-1f6cc68d717b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:21.703214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 106/214] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:21.704400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c91454-faf4-4059-8532-cd19d46fb837 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.704688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c91454-faf4-4059-8532-cd19d46fb837 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.704963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c91454-faf4-4059-8532-cd19d46fb837 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.706200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 107/215] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:21.707341 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41f0d5-c13f-43f3-8221-7c3512659388 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.707632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41f0d5-c13f-43f3-8221-7c3512659388 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.707905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41f0d5-c13f-43f3-8221-7c3512659388 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.709245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 108/216] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:21.712376 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922397b-a944-4bd9-b850-1bc322a51f0e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.712664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922397b-a944-4bd9-b850-1bc322a51f0e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.713409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922397b-a944-4bd9-b850-1bc322a51f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.731431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b922397b-a944-4bd9-b850-1bc322a51f0e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:21.732527 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bc2f1-f286-4ca7-a2f9-b9ec072ccc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:21.733169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc2f1-f286-4ca7-a2f9-b9ec072ccc33 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.733272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b922397b-a944-4bd9-b850-1bc322a51f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:21.733453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc2f1-f286-4ca7-a2f9-b9ec072ccc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.733726 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc2f1-f286-4ca7-a2f9-b9ec072ccc33 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.734435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bc2f1-f286-4ca7-a2f9-b9ec072ccc33 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:21.734735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bc2f1-f286-4ca7-a2f9-b9ec072ccc33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:21.736123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bc2f1-f286-4ca7-a2f9-b9ec072ccc33 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:21.744121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 109/217] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:21.744975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bc2f1-f286-4ca7-a2f9-b9ec072ccc33 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:21.749559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:21.799782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:21.805407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 109/218] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:21.806584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec55992-6095-435d-b63c-5ad126dd083f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.806887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec55992-6095-435d-b63c-5ad126dd083f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.807158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec55992-6095-435d-b63c-5ad126dd083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.824442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6ec55992-6095-435d-b63c-5ad126dd083f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:21.826506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6ec55992-6095-435d-b63c-5ad126dd083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:21.855170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bc2f1-f286-4ca7-a2f9-b9ec072ccc33 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:21.887582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fcdf4-8b12-4944-bd01-7049a09b6cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:21.888727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fcdf4-8b12-4944-bd01-7049a09b6cbb None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:21.889008 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fcdf4-8b12-4944-bd01-7049a09b6cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:21.889309 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fcdf4-8b12-4944-bd01-7049a09b6cbb None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:21.889985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fcdf4-8b12-4944-bd01-7049a09b6cbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:21.891422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fcdf4-8b12-4944-bd01-7049a09b6cbb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:21.893943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 110/219] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:21.894768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec55992-6095-435d-b63c-5ad126dd083f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:21.991246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec55992-6095-435d-b63c-5ad126dd083f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:22.009854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 110/220] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:19:21 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:19:22.011020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fcdf4-8b12-4944-bd01-7049a09b6cbb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:22.021542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:22.026449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b52c4c-f570-4111-956a-2359ab91c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:22.027210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b52c4c-f570-4111-956a-2359ab91c869 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:22.027488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b52c4c-f570-4111-956a-2359ab91c869 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:22.027764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b52c4c-f570-4111-956a-2359ab91c869 None admin] PATH_INFO: `/v3/users/f875a07e44594f3c97fe30c565954cc8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:22.042662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b52c4c-f570-4111-956a-2359ab91c869 None admin] RBAC: Authorizing `identity:get_user(user_id=f875a07e44594f3c97fe30c565954cc8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:22.044765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b52c4c-f570-4111-956a-2359ab91c869 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:22.048404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 111/221] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:21 2022] GET /identity/v3/users/f875a07e44594f3c97fe30c565954cc8 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:22.048404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b52c4c-f570-4111-956a-2359ab91c869 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:22.106386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:22.156337 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fcdf4-8b12-4944-bd01-7049a09b6cbb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:22.168192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b52c4c-f570-4111-956a-2359ab91c869 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:22.202599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676e799-4199-41c4-8cda-a6bf4fbb7d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:22.203249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e799-4199-41c4-8cda-a6bf4fbb7d87 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:22.203525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e799-4199-41c4-8cda-a6bf4fbb7d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:22.203839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676e799-4199-41c4-8cda-a6bf4fbb7d87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:22.206750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc60cdf-538c-49a5-b129-08f6a1b357aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:22.207144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc60cdf-538c-49a5-b129-08f6a1b357aa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:22.208492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc60cdf-538c-49a5-b129-08f6a1b357aa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:22.208492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc60cdf-538c-49a5-b129-08f6a1b357aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:22.216880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676e799-4199-41c4-8cda-a6bf4fbb7d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:22.220044 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc60cdf-538c-49a5-b129-08f6a1b357aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1676e799-4199-41c4-8cda-a6bf4fbb7d87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:22.222295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:22.223203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:22.224022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 111/222] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:22.224688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676e799-4199-41c4-8cda-a6bf4fbb7d87 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5dc60cdf-538c-49a5-b129-08f6a1b357aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:22.225084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:22.226035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:22.226832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 112/223] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:19:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:22.233175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc60cdf-538c-49a5-b129-08f6a1b357aa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:22.298413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:22.358323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc60cdf-538c-49a5-b129-08f6a1b357aa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:22.375990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676e799-4199-41c4-8cda-a6bf4fbb7d87 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:22.394127 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6a1b-6642-4ac1-ad2a-02801e73861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:22.394763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6a1b-6642-4ac1-ad2a-02801e73861a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:22.395426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6a1b-6642-4ac1-ad2a-02801e73861a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:22.395706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6a1b-6642-4ac1-ad2a-02801e73861a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:22.396710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6a1b-6642-4ac1-ad2a-02801e73861a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:22.397017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6a1b-6642-4ac1-ad2a-02801e73861a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:22.398916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6a1b-6642-4ac1-ad2a-02801e73861a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:22.401774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:22.410345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 113/224] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:22.411307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6a1b-6642-4ac1-ad2a-02801e73861a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:22.424026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0f1d6-f3f3-4452-a813-7dce3e60e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:22.425160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f1d6-f3f3-4452-a813-7dce3e60e45d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:22.425462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f1d6-f3f3-4452-a813-7dce3e60e45d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:22.425786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f1d6-f3f3-4452-a813-7dce3e60e45d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:22.514886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0f1d6-f3f3-4452-a813-7dce3e60e45d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:22.516899 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0f1d6-f3f3-4452-a813-7dce3e60e45d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:22.551876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6a1b-6642-4ac1-ad2a-02801e73861a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:22.566328 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:22.598115 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23df3a-02bc-4ee2-acd7-7c8cb9dc3fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:22.599039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23df3a-02bc-4ee2-acd7-7c8cb9dc3fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:22.599476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23df3a-02bc-4ee2-acd7-7c8cb9dc3fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:22.599857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23df3a-02bc-4ee2-acd7-7c8cb9dc3fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:22.600747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23df3a-02bc-4ee2-acd7-7c8cb9dc3fa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:22.601217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23df3a-02bc-4ee2-acd7-7c8cb9dc3fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:22.602933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23df3a-02bc-4ee2-acd7-7c8cb9dc3fa4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:22.613764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 114/225] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:22.614902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23df3a-02bc-4ee2-acd7-7c8cb9dc3fa4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:22.631815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 112/226] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:22.633237 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0f1d6-f3f3-4452-a813-7dce3e60e45d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:22.664256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:22.725922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23df3a-02bc-4ee2-acd7-7c8cb9dc3fa4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:22.764080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d688629-c156-4912-a72b-398ca8a23641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:22.764733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d688629-c156-4912-a72b-398ca8a23641 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:22.765015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d688629-c156-4912-a72b-398ca8a23641 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:22.765319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d688629-c156-4912-a72b-398ca8a23641 None admin] PATH_INFO: `/v3/users/eba8b729574d481c8256ea8a0b4c11c7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:22.766520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d688629-c156-4912-a72b-398ca8a23641 None admin] RBAC: Authorizing `identity:get_user(user_id=eba8b729574d481c8256ea8a0b4c11c7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:22.766836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0f1d6-f3f3-4452-a813-7dce3e60e45d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:22.767964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d688629-c156-4912-a72b-398ca8a23641 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:22.774743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 115/227] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:22 2022] GET /identity/v3/users/eba8b729574d481c8256ea8a0b4c11c7 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:22.774743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d688629-c156-4912-a72b-398ca8a23641 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:22.807961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e4f2c-d83c-4ebb-a110-a5301a0bf228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:22.808865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e4f2c-d83c-4ebb-a110-a5301a0bf228 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:22.809322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e4f2c-d83c-4ebb-a110-a5301a0bf228 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:22.810016 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e4f2c-d83c-4ebb-a110-a5301a0bf228 None admin] PATH_INFO: `/v3/users/eba8b729574d481c8256ea8a0b4c11c7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:22.811465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e4f2c-d83c-4ebb-a110-a5301a0bf228 None admin] RBAC: Authorizing `identity:get_user(user_id=eba8b729574d481c8256ea8a0b4c11c7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:22.813315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e4f2c-d83c-4ebb-a110-a5301a0bf228 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:22.815501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 113/228] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:22 2022] GET /identity/v3/users/eba8b729574d481c8256ea8a0b4c11c7 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:22.816425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e4f2c-d83c-4ebb-a110-a5301a0bf228 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:22.826991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:22.907791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d688629-c156-4912-a72b-398ca8a23641 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:22.922437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:22.936986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e4f2c-d83c-4ebb-a110-a5301a0bf228 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:22.954999 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfba229-7303-4d71-b018-3ab86853da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:22.955871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba229-7303-4d71-b018-3ab86853da4d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:22.956299 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba229-7303-4d71-b018-3ab86853da4d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:22.956716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba229-7303-4d71-b018-3ab86853da4d None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:22.958221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfba229-7303-4d71-b018-3ab86853da4d None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:22.959951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfba229-7303-4d71-b018-3ab86853da4d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:22.961910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 116/229] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:22 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:22.967530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfba229-7303-4d71-b018-3ab86853da4d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:22.977760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e589b97-5516-4bd9-9d06-d44ad70e7a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:22.978946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e589b97-5516-4bd9-9d06-d44ad70e7a0d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:22.979317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e589b97-5516-4bd9-9d06-d44ad70e7a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:22.979665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e589b97-5516-4bd9-9d06-d44ad70e7a0d None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:22.981388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e589b97-5516-4bd9-9d06-d44ad70e7a0d None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:22.984059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e589b97-5516-4bd9-9d06-d44ad70e7a0d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:22.989196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 114/230] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:22 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:22.990198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e589b97-5516-4bd9-9d06-d44ad70e7a0d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:23.088668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfba229-7303-4d71-b018-3ab86853da4d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:23.096749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e589b97-5516-4bd9-9d06-d44ad70e7a0d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:23.097861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:23.124232 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb75af8-6d5d-4526-a8f0-eb8e393892bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:23.125681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75af8-6d5d-4526-a8f0-eb8e393892bb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:23.125681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75af8-6d5d-4526-a8f0-eb8e393892bb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:23.125681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75af8-6d5d-4526-a8f0-eb8e393892bb None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:23.127033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb75af8-6d5d-4526-a8f0-eb8e393892bb None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:23.128490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb75af8-6d5d-4526-a8f0-eb8e393892bb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:23.130329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 117/231] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:22 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:23.131746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb75af8-6d5d-4526-a8f0-eb8e393892bb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:23.140368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c995e-ecf0-4ed0-bbc9-13a9e6f0a728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:23.142093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c995e-ecf0-4ed0-bbc9-13a9e6f0a728 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:23.142754 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c995e-ecf0-4ed0-bbc9-13a9e6f0a728 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:23.143271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c995e-ecf0-4ed0-bbc9-13a9e6f0a728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:23.144498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c995e-ecf0-4ed0-bbc9-13a9e6f0a728 None admin] RBAC: Adding query filter params (role.id=a21446fa03b24a5ebbaf61a4827146e7, scope.project.id=4fd381b007244ca79e5e671f37551f9a, user.id=f875a07e44594f3c97fe30c565954cc8) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:23.145018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c995e-ecf0-4ed0-bbc9-13a9e6f0a728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:23.146922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c995e-ecf0-4ed0-bbc9-13a9e6f0a728 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:23.155193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 115/232] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:22 2022] GET /identity/v3/role_assignments?user.id=f875a07e44594f3c97fe30c565954cc8&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:23.162393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c995e-ecf0-4ed0-bbc9-13a9e6f0a728 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:23.210747 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:23.244186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb75af8-6d5d-4526-a8f0-eb8e393892bb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:23.286688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9ff65-b32b-41e7-a1c8-1311897c8d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:23.287494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9ff65-b32b-41e7-a1c8-1311897c8d71 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:23.287842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9ff65-b32b-41e7-a1c8-1311897c8d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:23.288188 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9ff65-b32b-41e7-a1c8-1311897c8d71 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a/users/eba8b729574d481c8256ea8a0b4c11c7/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:23.290271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9ff65-b32b-41e7-a1c8-1311897c8d71 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fd381b007244ca79e5e671f37551f9a, user_id=eba8b729574d481c8256ea8a0b4c11c7, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:23.291784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9ff65-b32b-41e7-a1c8-1311897c8d71 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:23.344873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c995e-ecf0-4ed0-bbc9-13a9e6f0a728 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:23.365226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 118/233] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:19:23 2022] PUT /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a/users/eba8b729574d481c8256ea8a0b4c11c7/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:23.403123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eeee55-44db-4f7f-9954-2943aaf6d715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:23.404949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeee55-44db-4f7f-9954-2943aaf6d715 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:23.405311 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeee55-44db-4f7f-9954-2943aaf6d715 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:23.405618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeee55-44db-4f7f-9954-2943aaf6d715 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a/users/eba8b729574d481c8256ea8a0b4c11c7/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:23.408083 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eeee55-44db-4f7f-9954-2943aaf6d715 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fd381b007244ca79e5e671f37551f9a, user_id=eba8b729574d481c8256ea8a0b4c11c7, role_id=e24e5dc3a48b4cfdac7a99de5f2f78a7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:23.409718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eeee55-44db-4f7f-9954-2943aaf6d715 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:23.503527 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 116/234] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:19:23 2022] PUT /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a/users/eba8b729574d481c8256ea8a0b4c11c7/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:24.259868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087dcc2-2172-45b1-ba84-4bd1e1ea9bc3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:24.260498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087dcc2-2172-45b1-ba84-4bd1e1ea9bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:24.260964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087dcc2-2172-45b1-ba84-4bd1e1ea9bc3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:24.263351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 119/235] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:24.268537 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce3276-1cd1-4778-bae0-d42ec0c00089 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:24.269072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce3276-1cd1-4778-bae0-d42ec0c00089 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:24.269585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce3276-1cd1-4778-bae0-d42ec0c00089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:24.292740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b8ce3276-1cd1-4778-bae0-d42ec0c00089 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:24.294283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b8ce3276-1cd1-4778-bae0-d42ec0c00089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:24.345358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023e01-3aac-40cb-83ab-55cde1582069 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:24.345963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023e01-3aac-40cb-83ab-55cde1582069 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:24.346430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44023e01-3aac-40cb-83ab-55cde1582069 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:24.347972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 120/236] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:24.352729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856baf9-48e5-4797-833a-9405464200f5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:24.353283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856baf9-48e5-4797-833a-9405464200f5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:24.353754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856baf9-48e5-4797-833a-9405464200f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:24.384274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9856baf9-48e5-4797-833a-9405464200f5 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:24.386231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9856baf9-48e5-4797-833a-9405464200f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:24.414499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 117/237] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:24.441231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:24.452001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce3276-1cd1-4778-bae0-d42ec0c00089 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:24.482121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:24.522777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 121/238] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:24.557157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856baf9-48e5-4797-833a-9405464200f5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:24.614128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce3276-1cd1-4778-bae0-d42ec0c00089 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:24.652221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48f6b-01d3-4cd9-ab95-685528f0087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:24.652867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48f6b-01d3-4cd9-ab95-685528f0087d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:24.653156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48f6b-01d3-4cd9-ab95-685528f0087d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:24.654315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a48f6b-01d3-4cd9-ab95-685528f0087d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:24.675176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a48f6b-01d3-4cd9-ab95-685528f0087d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-75a48f6b-01d3-4cd9-ab95-685528f0087d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:24.680352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:24.681254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:24.682067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 118/239] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:24.690693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48f6b-01d3-4cd9-ab95-685528f0087d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:24.738278 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856baf9-48e5-4797-833a-9405464200f5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:24.792581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:24.812501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91732951-c20e-4563-9084-c77be9c0ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:24.813316 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91732951-c20e-4563-9084-c77be9c0ed11 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:24.813602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91732951-c20e-4563-9084-c77be9c0ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:24.813877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91732951-c20e-4563-9084-c77be9c0ed11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:24.817850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91732951-c20e-4563-9084-c77be9c0ed11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:24.819324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91732951-c20e-4563-9084-c77be9c0ed11 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:24.821120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 122/240] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:24.826695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91732951-c20e-4563-9084-c77be9c0ed11 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:24.827267 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a48f6b-01d3-4cd9-ab95-685528f0087d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:24.866093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455041f-c219-421e-9618-0cf93aaa6459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:24.867414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455041f-c219-421e-9618-0cf93aaa6459 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:24.867815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455041f-c219-421e-9618-0cf93aaa6459 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:24.868184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455041f-c219-421e-9618-0cf93aaa6459 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:24.869264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455041f-c219-421e-9618-0cf93aaa6459 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:24.869811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455041f-c219-421e-9618-0cf93aaa6459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:24.876884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455041f-c219-421e-9618-0cf93aaa6459 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:24.884366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 119/241] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:24.893398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455041f-c219-421e-9618-0cf93aaa6459 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:24.893530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:24.965667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91732951-c20e-4563-9084-c77be9c0ed11 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:25.002031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057b022-83fa-418b-804f-16ddf2951741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:25.003359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057b022-83fa-418b-804f-16ddf2951741 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:25.003643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057b022-83fa-418b-804f-16ddf2951741 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:25.003918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057b022-83fa-418b-804f-16ddf2951741 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:25.004600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057b022-83fa-418b-804f-16ddf2951741 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:25.006079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057b022-83fa-418b-804f-16ddf2951741 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:25.088427 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455041f-c219-421e-9618-0cf93aaa6459 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:25.101846 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 123/242] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:19:24 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:19:25.128731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:25.134006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee86009-c0a8-4133-82f4-e7611bfc6efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:25.134662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86009-c0a8-4133-82f4-e7611bfc6efb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:25.134938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86009-c0a8-4133-82f4-e7611bfc6efb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:25.135208 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86009-c0a8-4133-82f4-e7611bfc6efb None admin] PATH_INFO: `/v3/users/2df9676b2e714d8a8640af5778b1ad01` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:25.151821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee86009-c0a8-4133-82f4-e7611bfc6efb None admin] RBAC: Authorizing `identity:get_user(user_id=2df9676b2e714d8a8640af5778b1ad01)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:25.159391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee86009-c0a8-4133-82f4-e7611bfc6efb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:25.161678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 120/243] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:24 2022] GET /identity/v3/users/2df9676b2e714d8a8640af5778b1ad01 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:25.170004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057b022-83fa-418b-804f-16ddf2951741 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:25.335538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:25.346527 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057b022-83fa-418b-804f-16ddf2951741 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:25.385017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c91a4-4617-40e3-b892-01736a022f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:25.385679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c91a4-4617-40e3-b892-01736a022f11 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:25.385944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c91a4-4617-40e3-b892-01736a022f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:25.386225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c91a4-4617-40e3-b892-01736a022f11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:25.461880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c91a4-4617-40e3-b892-01736a022f11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:25.463582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c91a4-4617-40e3-b892-01736a022f11 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:25.569932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:25.583187 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 124/244] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:25.589090 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee86009-c0a8-4133-82f4-e7611bfc6efb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:25.713240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee86009-c0a8-4133-82f4-e7611bfc6efb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:25.727296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7c300-31b5-46d4-9d87-af3fe7a25135 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:25.727579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7c300-31b5-46d4-9d87-af3fe7a25135 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:25.727850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7c300-31b5-46d4-9d87-af3fe7a25135 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:25.729220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 125/245] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:25.736218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a616b23-aa83-425a-8e3c-dfb15881231f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:25.736799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a616b23-aa83-425a-8e3c-dfb15881231f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:25.737275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a616b23-aa83-425a-8e3c-dfb15881231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:25.759586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0f728-eca2-4767-939e-73801e32618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:25.760248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0f728-eca2-4767-939e-73801e32618b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:25.760518 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0f728-eca2-4767-939e-73801e32618b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:25.760786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0f728-eca2-4767-939e-73801e32618b None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:25.763448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0f728-eca2-4767-939e-73801e32618b None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:25.764905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0f728-eca2-4767-939e-73801e32618b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:25.766993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 121/246] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:25 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:25.775015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0f728-eca2-4767-939e-73801e32618b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:25.776631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1a616b23-aa83-425a-8e3c-dfb15881231f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:25.777819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1a616b23-aa83-425a-8e3c-dfb15881231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:25.850048 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:25.874107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 126/247] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:25.897842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0f728-eca2-4767-939e-73801e32618b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:25.900354 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a616b23-aa83-425a-8e3c-dfb15881231f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:25.938052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb39fb5-b2c1-4ba7-ae61-b2994301984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:25.938679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39fb5-b2c1-4ba7-ae61-b2994301984e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:25.938964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39fb5-b2c1-4ba7-ae61-b2994301984e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:25.939348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39fb5-b2c1-4ba7-ae61-b2994301984e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:25.940142 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb39fb5-b2c1-4ba7-ae61-b2994301984e None admin] RBAC: Adding query filter params (role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6, scope.project.id=4fd381b007244ca79e5e671f37551f9a, user.id=2df9676b2e714d8a8640af5778b1ad01) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:25.940619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb39fb5-b2c1-4ba7-ae61-b2994301984e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:25.942263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb39fb5-b2c1-4ba7-ae61-b2994301984e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:25.948866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 122/248] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:25 2022] GET /identity/v3/role_assignments?user.id=2df9676b2e714d8a8640af5778b1ad01&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:25.988109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dd005-d55b-4c72-9f79-8f5f8bb9414a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:25.988398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dd005-d55b-4c72-9f79-8f5f8bb9414a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:25.988841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dd005-d55b-4c72-9f79-8f5f8bb9414a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:25.990560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 123/249] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:25.996057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad745-05a1-4eab-829d-261c422ffffd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:25.996671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad745-05a1-4eab-829d-261c422ffffd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:25.997032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ad745-05a1-4eab-829d-261c422ffffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:26.027306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-046ad745-05a1-4eab-829d-261c422ffffd None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:26.029835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-046ad745-05a1-4eab-829d-261c422ffffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:26.036236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a616b23-aa83-425a-8e3c-dfb15881231f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:26.074965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:26.104564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb933df-c850-49c4-9f05-7b5f249c2b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:26.105182 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb933df-c850-49c4-9f05-7b5f249c2b57 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:26.105472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb933df-c850-49c4-9f05-7b5f249c2b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:26.105747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb933df-c850-49c4-9f05-7b5f249c2b57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:26.124825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb933df-c850-49c4-9f05-7b5f249c2b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8bb933df-c850-49c4-9f05-7b5f249c2b57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:26.129943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:26.130899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:26.131698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 127/250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:26.133681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4937568-30cf-4aa5-8f47-e80a0e09ab81 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:26.136930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4937568-30cf-4aa5-8f47-e80a0e09ab81 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:26.138725 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4937568-30cf-4aa5-8f47-e80a0e09ab81 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:26.143385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 128/251] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:26.144028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4937568-30cf-4aa5-8f47-e80a0e09ab81 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:26.174998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 124/252] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:26.177018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed010d5-5171-4df0-8345-0a85ac813b8f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:26.177337 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed010d5-5171-4df0-8345-0a85ac813b8f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:26.177826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed010d5-5171-4df0-8345-0a85ac813b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:26.210502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1ed010d5-5171-4df0-8345-0a85ac813b8f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:26.212813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1ed010d5-5171-4df0-8345-0a85ac813b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:26.307084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4937568-30cf-4aa5-8f47-e80a0e09ab81 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:26.317492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:26.345248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd428b7-24c4-4098-ab27-7c52868d3fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:26.355350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd428b7-24c4-4098-ab27-7c52868d3fae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:26.355350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd428b7-24c4-4098-ab27-7c52868d3fae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:26.355350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd428b7-24c4-4098-ab27-7c52868d3fae None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:26.355592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 125/253] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:26.355664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd428b7-24c4-4098-ab27-7c52868d3fae None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:26.355664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd428b7-24c4-4098-ab27-7c52868d3fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:26.355794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed010d5-5171-4df0-8345-0a85ac813b8f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:26.355862 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd428b7-24c4-4098-ab27-7c52868d3fae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:26.359511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 129/254] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:26.370447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd428b7-24c4-4098-ab27-7c52868d3fae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:26.457150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:26.496278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed010d5-5171-4df0-8345-0a85ac813b8f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:26.558964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd428b7-24c4-4098-ab27-7c52868d3fae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:26.569348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22aff6-39e9-468c-88d4-fa16d660954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:26.570004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22aff6-39e9-468c-88d4-fa16d660954d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:26.570284 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22aff6-39e9-468c-88d4-fa16d660954d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:26.570555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22aff6-39e9-468c-88d4-fa16d660954d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:26.588644 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22aff6-39e9-468c-88d4-fa16d660954d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ea22aff6-39e9-468c-88d4-fa16d660954d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:26.593926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:26.595225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 126/255] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:26.596024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22aff6-39e9-468c-88d4-fa16d660954d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:26.632986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d69ee-b07c-4e8d-97ed-fc4a2d14c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:26.633597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d69ee-b07c-4e8d-97ed-fc4a2d14c621 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:26.633876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d69ee-b07c-4e8d-97ed-fc4a2d14c621 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:26.634150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d69ee-b07c-4e8d-97ed-fc4a2d14c621 None admin] PATH_INFO: `/v3/users/f875a07e44594f3c97fe30c565954cc8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:26.635533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d69ee-b07c-4e8d-97ed-fc4a2d14c621 None admin] RBAC: Authorizing `identity:get_user(user_id=f875a07e44594f3c97fe30c565954cc8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:26.636984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d69ee-b07c-4e8d-97ed-fc4a2d14c621 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:26.639510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 130/256] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:26 2022] GET /identity/v3/users/f875a07e44594f3c97fe30c565954cc8 => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:26.640102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d69ee-b07c-4e8d-97ed-fc4a2d14c621 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:26.670430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:26.733538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22aff6-39e9-468c-88d4-fa16d660954d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:26.772951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03400494-c222-4eda-b847-b8b7d4d3c6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:26.773623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03400494-c222-4eda-b847-b8b7d4d3c6fc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:26.773901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03400494-c222-4eda-b847-b8b7d4d3c6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:26.774176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03400494-c222-4eda-b847-b8b7d4d3c6fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:26.784941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03400494-c222-4eda-b847-b8b7d4d3c6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-03400494-c222-4eda-b847-b8b7d4d3c6fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:26.790585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:26.791468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:26.792280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 127/257] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:26.792948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03400494-c222-4eda-b847-b8b7d4d3c6fc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:26.895257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03400494-c222-4eda-b847-b8b7d4d3c6fc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:26.896933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d69ee-b07c-4e8d-97ed-fc4a2d14c621 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:26.898716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:26.918561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:26.932850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650ed87-9a36-4470-92b0-8cb790d2bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:26.933797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650ed87-9a36-4470-92b0-8cb790d2bed3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:26.934322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650ed87-9a36-4470-92b0-8cb790d2bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:26.935413 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650ed87-9a36-4470-92b0-8cb790d2bed3 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:26.936769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650ed87-9a36-4470-92b0-8cb790d2bed3 None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:26.938467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650ed87-9a36-4470-92b0-8cb790d2bed3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:26.940342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 128/258] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:26 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:26.941421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650ed87-9a36-4470-92b0-8cb790d2bed3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:26.998762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feb129-e930-4f51-a249-12753ea4302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:26.999404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feb129-e930-4f51-a249-12753ea4302b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:26.999688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feb129-e930-4f51-a249-12753ea4302b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:26.999962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feb129-e930-4f51-a249-12753ea4302b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:27.000773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feb129-e930-4f51-a249-12753ea4302b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:27.001082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feb129-e930-4f51-a249-12753ea4302b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:27.002489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feb129-e930-4f51-a249-12753ea4302b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:27.021381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 131/259] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:27.022031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feb129-e930-4f51-a249-12753ea4302b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:27.082409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650ed87-9a36-4470-92b0-8cb790d2bed3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:27.147415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed3dc5-4132-4e23-a332-f8ea3b33539d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:27.147979 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed3dc5-4132-4e23-a332-f8ea3b33539d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:27.148259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed3dc5-4132-4e23-a332-f8ea3b33539d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:27.148530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed3dc5-4132-4e23-a332-f8ea3b33539d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:27.149317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed3dc5-4132-4e23-a332-f8ea3b33539d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:27.149620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed3dc5-4132-4e23-a332-f8ea3b33539d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:27.151030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed3dc5-4132-4e23-a332-f8ea3b33539d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:27.174708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 129/260] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:27.177108 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed3dc5-4132-4e23-a332-f8ea3b33539d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:27.239256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feb129-e930-4f51-a249-12753ea4302b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:27.246725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:27.310759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a241-431c-4349-9357-afed2fa66cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:27.311517 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a241-431c-4349-9357-afed2fa66cf1 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:27.311809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a241-431c-4349-9357-afed2fa66cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:27.312085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a241-431c-4349-9357-afed2fa66cf1 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a/users/f875a07e44594f3c97fe30c565954cc8/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:27.317900 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9a241-431c-4349-9357-afed2fa66cf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fd381b007244ca79e5e671f37551f9a, user_id=f875a07e44594f3c97fe30c565954cc8, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:27.319097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed3dc5-4132-4e23-a332-f8ea3b33539d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:27.319356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9a241-431c-4349-9357-afed2fa66cf1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:27.357657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02de674-0b82-4326-a66d-dfc6ddb20ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:27.358546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02de674-0b82-4326-a66d-dfc6ddb20ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:27.358967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02de674-0b82-4326-a66d-dfc6ddb20ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:27.359379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02de674-0b82-4326-a66d-dfc6ddb20ee4 None admin] PATH_INFO: `/v3/users/eba8b729574d481c8256ea8a0b4c11c7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:27.360870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02de674-0b82-4326-a66d-dfc6ddb20ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=eba8b729574d481c8256ea8a0b4c11c7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:27.362494 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02de674-0b82-4326-a66d-dfc6ddb20ee4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:27.364592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 130/261] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:27 2022] GET /identity/v3/users/eba8b729574d481c8256ea8a0b4c11c7 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:27.365520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02de674-0b82-4326-a66d-dfc6ddb20ee4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:27.420360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 132/262] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:19:27 2022] PUT /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a/users/f875a07e44594f3c97fe30c565954cc8/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:27.421440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a241-431c-4349-9357-afed2fa66cf1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:27.475735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02de674-0b82-4326-a66d-dfc6ddb20ee4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:27.484525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:27.489760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:27.515411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce6aba-42ed-4b0a-8133-657544f95d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:27.516365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce6aba-42ed-4b0a-8133-657544f95d00 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:27.516787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce6aba-42ed-4b0a-8133-657544f95d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:27.517266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce6aba-42ed-4b0a-8133-657544f95d00 None admin] PATH_INFO: `/v3/users/eba8b729574d481c8256ea8a0b4c11c7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:27.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce6aba-42ed-4b0a-8133-657544f95d00 None admin] RBAC: Authorizing `identity:get_user(user_id=eba8b729574d481c8256ea8a0b4c11c7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:27.520415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce6aba-42ed-4b0a-8133-657544f95d00 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:27.522268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 131/263] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:27 2022] GET /identity/v3/users/eba8b729574d481c8256ea8a0b4c11c7 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:27.531680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce6aba-42ed-4b0a-8133-657544f95d00 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:27.655908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a241-431c-4349-9357-afed2fa66cf1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:27.730499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b99487-498e-4336-bb86-20023a663f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:27.731053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b99487-498e-4336-bb86-20023a663f57 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:27.732981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b99487-498e-4336-bb86-20023a663f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:27.732981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b99487-498e-4336-bb86-20023a663f57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:27.740015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce6aba-42ed-4b0a-8133-657544f95d00 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:27.786177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681976ee-563d-423f-b380-51946ed6794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:27.786783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681976ee-563d-423f-b380-51946ed6794b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:27.787060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681976ee-563d-423f-b380-51946ed6794b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:27.787327 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681976ee-563d-423f-b380-51946ed6794b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:27.839957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:27.892234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681976ee-563d-423f-b380-51946ed6794b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:27.893857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681976ee-563d-423f-b380-51946ed6794b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:27.904898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b99487-498e-4336-bb86-20023a663f57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:27.910582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b99487-498e-4336-bb86-20023a663f57 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:27.998292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:28.007432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 132/264] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:28.017189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681976ee-563d-423f-b380-51946ed6794b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:28.116131 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:28.124350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681976ee-563d-423f-b380-51946ed6794b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:28.169995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054305a-3ec0-4d38-8e99-1adc14bc16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:28.170455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054305a-3ec0-4d38-8e99-1adc14bc16c2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:28.170733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054305a-3ec0-4d38-8e99-1adc14bc16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:28.171002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054305a-3ec0-4d38-8e99-1adc14bc16c2 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:28.172041 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 133/265] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:28.172237 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054305a-3ec0-4d38-8e99-1adc14bc16c2 None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:28.173794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054305a-3ec0-4d38-8e99-1adc14bc16c2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:28.175745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 133/266] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:28 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:28.177484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b99487-498e-4336-bb86-20023a663f57 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:28.181283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054305a-3ec0-4d38-8e99-1adc14bc16c2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:28.351226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054305a-3ec0-4d38-8e99-1adc14bc16c2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:28.393080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad67c7d-4403-4bce-bc60-abe34a2f1bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:28.394261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67c7d-4403-4bce-bc60-abe34a2f1bbe None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:28.394716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67c7d-4403-4bce-bc60-abe34a2f1bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:28.395292 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad67c7d-4403-4bce-bc60-abe34a2f1bbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:28.396872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad67c7d-4403-4bce-bc60-abe34a2f1bbe None admin] RBAC: Adding query filter params (role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7, scope.project.id=4fd381b007244ca79e5e671f37551f9a, user.id=eba8b729574d481c8256ea8a0b4c11c7) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:28.397401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad67c7d-4403-4bce-bc60-abe34a2f1bbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:28.399517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad67c7d-4403-4bce-bc60-abe34a2f1bbe None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:28.404411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:28.405934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b99487-498e-4336-bb86-20023a663f57 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:28.409442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 134/267] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:28 2022] GET /identity/v3/role_assignments?user.id=eba8b729574d481c8256ea8a0b4c11c7&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:28.411643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c81002-09ec-499d-920d-7f5dc3f02d33 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:28.411927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c81002-09ec-499d-920d-7f5dc3f02d33 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:28.412196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c81002-09ec-499d-920d-7f5dc3f02d33 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:28.413466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 135/268] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:28.419799 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a02aa-d951-4370-b585-d0b402411a62 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:28.420553 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a02aa-d951-4370-b585-d0b402411a62 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:28.421034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a02aa-d951-4370-b585-d0b402411a62 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:28.422704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 136/269] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:28.424459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bc6db-84c1-4865-9a84-ffd9d9607875 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:28.424881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bc6db-84c1-4865-9a84-ffd9d9607875 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:28.425340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bc6db-84c1-4865-9a84-ffd9d9607875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:28.446236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a98bc6db-84c1-4865-9a84-ffd9d9607875 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:28.447199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:28.448523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a98bc6db-84c1-4865-9a84-ffd9d9607875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:28.453904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad7a2f-6bd5-4ce2-adb6-0cdb6b2bd188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:28.455316 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad7a2f-6bd5-4ce2-adb6-0cdb6b2bd188 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:28.455605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad7a2f-6bd5-4ce2-adb6-0cdb6b2bd188 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:28.455884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad7a2f-6bd5-4ce2-adb6-0cdb6b2bd188 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:28.457286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad7a2f-6bd5-4ce2-adb6-0cdb6b2bd188 None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:28.460595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad7a2f-6bd5-4ce2-adb6-0cdb6b2bd188 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:28.464020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 134/270] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:28 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:28.466443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b640a-bd3f-4dee-8e82-824780b382db None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:28.466731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b640a-bd3f-4dee-8e82-824780b382db None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:28.467008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b640a-bd3f-4dee-8e82-824780b382db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:28.489705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-889b640a-bd3f-4dee-8e82-824780b382db None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:28.491362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-889b640a-bd3f-4dee-8e82-824780b382db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:28.553458 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 137/271] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:28.558176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bc6db-84c1-4865-9a84-ffd9d9607875 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:28.609967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 135/272] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:28.611540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220170-c884-405c-b49e-5f99ccdc96eb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:28.611831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220170-c884-405c-b49e-5f99ccdc96eb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:28.612105 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220170-c884-405c-b49e-5f99ccdc96eb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:28.613419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 136/273] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:28.614121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220170-c884-405c-b49e-5f99ccdc96eb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:28.684549 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bc6db-84c1-4865-9a84-ffd9d9607875 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:28.720027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:28.728341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321fff9-0789-4312-bd32-48ee0be85dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:28.729028 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fff9-0789-4312-bd32-48ee0be85dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:28.729340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fff9-0789-4312-bd32-48ee0be85dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:28.729630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321fff9-0789-4312-bd32-48ee0be85dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:28.730419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321fff9-0789-4312-bd32-48ee0be85dc7 None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=4fd381b007244ca79e5e671f37551f9a, user.id=eba8b729574d481c8256ea8a0b4c11c7) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:28.730724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321fff9-0789-4312-bd32-48ee0be85dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:28.732590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321fff9-0789-4312-bd32-48ee0be85dc7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:28.739620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 138/274] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:28 2022] GET /identity/v3/role_assignments?user.id=eba8b729574d481c8256ea8a0b4c11c7&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=57a86ff4c9de433399662eebf6893065 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:28.740930 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497cf27-27ba-4a15-b565-7e839cab6572 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:28.741500 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497cf27-27ba-4a15-b565-7e839cab6572 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:28.741698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497cf27-27ba-4a15-b565-7e839cab6572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:28.747070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220170-c884-405c-b49e-5f99ccdc96eb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:28.768850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4497cf27-27ba-4a15-b565-7e839cab6572 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:28.770126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4497cf27-27ba-4a15-b565-7e839cab6572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:28.789610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:28.794735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2db8d-7cfb-4fd9-ab3a-5ff08f2d5d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:28.795790 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2db8d-7cfb-4fd9-ab3a-5ff08f2d5d41 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:28.796271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2db8d-7cfb-4fd9-ab3a-5ff08f2d5d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:28.796774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2db8d-7cfb-4fd9-ab3a-5ff08f2d5d41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:28.798405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2db8d-7cfb-4fd9-ab3a-5ff08f2d5d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:28.800398 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2db8d-7cfb-4fd9-ab3a-5ff08f2d5d41 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:28.802777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 137/275] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:28.809681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2db8d-7cfb-4fd9-ab3a-5ff08f2d5d41 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:28.854252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 139/276] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:28.855439 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497cf27-27ba-4a15-b565-7e839cab6572 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:28.955148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2db8d-7cfb-4fd9-ab3a-5ff08f2d5d41 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:28.978912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497cf27-27ba-4a15-b565-7e839cab6572 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:29.001682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef9317-6291-48a3-907a-017345e599de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:29.002846 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9317-6291-48a3-907a-017345e599de None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:29.003083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9317-6291-48a3-907a-017345e599de None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:29.003541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9317-6291-48a3-907a-017345e599de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:29.008939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:29.018277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ab06b-1c2a-446c-b0ac-e2cdb4afcde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:29.018444 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef9317-6291-48a3-907a-017345e599de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:29.018903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ab06b-1c2a-446c-b0ac-e2cdb4afcde8 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:29.019184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ab06b-1c2a-446c-b0ac-e2cdb4afcde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:29.019457 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ab06b-1c2a-446c-b0ac-e2cdb4afcde8 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:29.020149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ab06b-1c2a-446c-b0ac-e2cdb4afcde8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:29.021744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ab06b-1c2a-446c-b0ac-e2cdb4afcde8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-eaef9317-6291-48a3-907a-017345e599de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:29.026552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:29.027437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:29.028345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 138/277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:29.029082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef9317-6291-48a3-907a-017345e599de None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:29.088610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:29.129966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef9317-6291-48a3-907a-017345e599de None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:29.141164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 140/278] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:19:28 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:19:29.141164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ab06b-1c2a-446c-b0ac-e2cdb4afcde8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:29.201215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d9005-cad4-465c-98ca-0cff350307d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:29.202038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d9005-cad4-465c-98ca-0cff350307d0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:29.202428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d9005-cad4-465c-98ca-0cff350307d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:29.202861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d9005-cad4-465c-98ca-0cff350307d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:29.218202 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d9005-cad4-465c-98ca-0cff350307d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d73d9005-cad4-465c-98ca-0cff350307d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:29.223893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:29.224843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:29.225677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 139/279] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:29.235008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d9005-cad4-465c-98ca-0cff350307d0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:29.290411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ab06b-1c2a-446c-b0ac-e2cdb4afcde8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:29.333830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eee9f-8cb0-490c-bfb6-f1781365919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:29.334455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eee9f-8cb0-490c-bfb6-f1781365919a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:29.334728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eee9f-8cb0-490c-bfb6-f1781365919a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:29.334991 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eee9f-8cb0-490c-bfb6-f1781365919a None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:29.335709 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832eee9f-8cb0-490c-bfb6-f1781365919a None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:29.336006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832eee9f-8cb0-490c-bfb6-f1781365919a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:29.337442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832eee9f-8cb0-490c-bfb6-f1781365919a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:29.345996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 141/280] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:29.352193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eee9f-8cb0-490c-bfb6-f1781365919a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:29.368746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d9005-cad4-465c-98ca-0cff350307d0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:29.387047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:29.404478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:29.412841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e382737-ef57-4664-8888-5f1f945970ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:29.413707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382737-ef57-4664-8888-5f1f945970ba None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:29.413986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382737-ef57-4664-8888-5f1f945970ba None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:29.414295 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382737-ef57-4664-8888-5f1f945970ba None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:29.415013 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e382737-ef57-4664-8888-5f1f945970ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:29.415313 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e382737-ef57-4664-8888-5f1f945970ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:29.416837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e382737-ef57-4664-8888-5f1f945970ba None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:29.430020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 140/281] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:29.436253 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e382737-ef57-4664-8888-5f1f945970ba None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:29.488890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eee9f-8cb0-490c-bfb6-f1781365919a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:29.524456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12920d-1b71-459b-81ba-46a023d6bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:29.525112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12920d-1b71-459b-81ba-46a023d6bd3d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:29.525446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12920d-1b71-459b-81ba-46a023d6bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:29.525719 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12920d-1b71-459b-81ba-46a023d6bd3d None admin] PATH_INFO: `/v3/users/16143d22933f41c3a40cef1ba110995f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:29.541038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12920d-1b71-459b-81ba-46a023d6bd3d None admin] RBAC: Authorizing `identity:get_user(user_id=16143d22933f41c3a40cef1ba110995f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:29.542869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12920d-1b71-459b-81ba-46a023d6bd3d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:29.545717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 142/282] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:29 2022] GET /identity/v3/users/16143d22933f41c3a40cef1ba110995f => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:29.552782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12920d-1b71-459b-81ba-46a023d6bd3d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:29.566343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e382737-ef57-4664-8888-5f1f945970ba None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:29.614873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a411c-256a-45e9-86c2-23d2dfbff380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:29.615529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a411c-256a-45e9-86c2-23d2dfbff380 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:29.615815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a411c-256a-45e9-86c2-23d2dfbff380 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:29.616090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a411c-256a-45e9-86c2-23d2dfbff380 None admin] PATH_INFO: `/v3/users/2df9676b2e714d8a8640af5778b1ad01` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:29.617319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a411c-256a-45e9-86c2-23d2dfbff380 None admin] RBAC: Authorizing `identity:get_user(user_id=2df9676b2e714d8a8640af5778b1ad01)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:29.618797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a411c-256a-45e9-86c2-23d2dfbff380 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:29.620838 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 141/283] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:29 2022] GET /identity/v3/users/2df9676b2e714d8a8640af5778b1ad01 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:29.626995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a411c-256a-45e9-86c2-23d2dfbff380 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:29.673806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:29.676541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12920d-1b71-459b-81ba-46a023d6bd3d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:29.689259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:29.722644 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f66e-79f2-47ca-b135-82426c67c4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:29.723580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f66e-79f2-47ca-b135-82426c67c4fb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:29.724043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f66e-79f2-47ca-b135-82426c67c4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:29.724523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f66e-79f2-47ca-b135-82426c67c4fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:29.725574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570f66e-79f2-47ca-b135-82426c67c4fb None admin] RBAC: Adding query filter params (role.id=a21446fa03b24a5ebbaf61a4827146e7, user.id=16143d22933f41c3a40cef1ba110995f, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:29.726552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570f66e-79f2-47ca-b135-82426c67c4fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:29.728240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570f66e-79f2-47ca-b135-82426c67c4fb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:29.734993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 143/284] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 05:19:29 2022] GET /identity/v3/role_assignments?user.id=16143d22933f41c3a40cef1ba110995f&scope.system=all&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:29.782688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a411c-256a-45e9-86c2-23d2dfbff380 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:29.836795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3b216-6008-4594-8f07-27a8f5271037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:29.837466 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b216-6008-4594-8f07-27a8f5271037 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:29.837743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b216-6008-4594-8f07-27a8f5271037 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:29.838008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b216-6008-4594-8f07-27a8f5271037 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:29.839162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3b216-6008-4594-8f07-27a8f5271037 None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:29.841261 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3b216-6008-4594-8f07-27a8f5271037 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:29.846436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 142/285] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:29 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:29.849189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f66e-79f2-47ca-b135-82426c67c4fb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:30.009273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f66e-79f2-47ca-b135-82426c67c4fb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:30.054466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133238a6-c1f1-4d7d-adbf-d27f83ff0644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:30.055499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133238a6-c1f1-4d7d-adbf-d27f83ff0644 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:30.055982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133238a6-c1f1-4d7d-adbf-d27f83ff0644 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:30.056452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133238a6-c1f1-4d7d-adbf-d27f83ff0644 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a/users/2df9676b2e714d8a8640af5778b1ad01/roles/a1a15b7daf9f4fa697a9d35e7ce7dab6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:30.060646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133238a6-c1f1-4d7d-adbf-d27f83ff0644 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fd381b007244ca79e5e671f37551f9a, user_id=2df9676b2e714d8a8640af5778b1ad01, role_id=a1a15b7daf9f4fa697a9d35e7ce7dab6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:30.062357 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133238a6-c1f1-4d7d-adbf-d27f83ff0644 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:30.103254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f6136-c606-411e-980b-373c10244bb7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:30.103562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f6136-c606-411e-980b-373c10244bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:30.103799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f6136-c606-411e-980b-373c10244bb7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:30.105296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 143/286] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:30.110419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944e57c-72fe-475b-bddb-013db7448229 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:30.110698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944e57c-72fe-475b-bddb-013db7448229 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:30.110966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944e57c-72fe-475b-bddb-013db7448229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:30.130727 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8944e57c-72fe-475b-bddb-013db7448229 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:30.137265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8944e57c-72fe-475b-bddb-013db7448229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:30.160507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 144/287] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:19:29 2022] PUT /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a/users/2df9676b2e714d8a8640af5778b1ad01/roles/a1a15b7daf9f4fa697a9d35e7ce7dab6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:30.239528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 144/288] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:30.278982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133238a6-c1f1-4d7d-adbf-d27f83ff0644 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:30.314201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:30.407514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133238a6-c1f1-4d7d-adbf-d27f83ff0644 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:30.460194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73d2a7-0447-4f80-ba37-d00d23bebdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:30.460843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73d2a7-0447-4f80-ba37-d00d23bebdee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:30.461122 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73d2a7-0447-4f80-ba37-d00d23bebdee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:30.461413 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73d2a7-0447-4f80-ba37-d00d23bebdee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:30.482435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73d2a7-0447-4f80-ba37-d00d23bebdee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9f73d2a7-0447-4f80-ba37-d00d23bebdee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:30.487391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:30.488260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:30.489483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 145/289] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:30.496196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944e57c-72fe-475b-bddb-013db7448229 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:30.659177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:30.730113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944e57c-72fe-475b-bddb-013db7448229 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:30.781506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e07aa-be1a-4a34-ba59-43620881dbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:30.782130 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e07aa-be1a-4a34-ba59-43620881dbfc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:30.782405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e07aa-be1a-4a34-ba59-43620881dbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:30.782673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e07aa-be1a-4a34-ba59-43620881dbfc None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:30.783391 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e07aa-be1a-4a34-ba59-43620881dbfc None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:30.783691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e07aa-be1a-4a34-ba59-43620881dbfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:30.785074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e07aa-be1a-4a34-ba59-43620881dbfc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:30.794649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 145/290] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:30.800114 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73d2a7-0447-4f80-ba37-d00d23bebdee None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:30.934963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:30.959250 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73d2a7-0447-4f80-ba37-d00d23bebdee None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:30.996339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7af6b-c3ed-4a2b-beca-521d189d252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:30.997058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7af6b-c3ed-4a2b-beca-521d189d252d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:30.997362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7af6b-c3ed-4a2b-beca-521d189d252d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:30.997631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7af6b-c3ed-4a2b-beca-521d189d252d None admin] PATH_INFO: `/v3/users/f875a07e44594f3c97fe30c565954cc8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:30.998905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7af6b-c3ed-4a2b-beca-521d189d252d None admin] RBAC: Authorizing `identity:get_user(user_id=f875a07e44594f3c97fe30c565954cc8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:31.000353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7af6b-c3ed-4a2b-beca-521d189d252d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:31.002398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 146/291] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:30 2022] GET /identity/v3/users/f875a07e44594f3c97fe30c565954cc8 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:31.010247 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e07aa-be1a-4a34-ba59-43620881dbfc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:31.135123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e07aa-be1a-4a34-ba59-43620881dbfc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:31.144499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:31.178655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909fd6c-c8a0-48fb-bb71-ed84b45acf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:31.179571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909fd6c-c8a0-48fb-bb71-ed84b45acf36 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:31.179850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909fd6c-c8a0-48fb-bb71-ed84b45acf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:31.180122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909fd6c-c8a0-48fb-bb71-ed84b45acf36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:31.279408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909fd6c-c8a0-48fb-bb71-ed84b45acf36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:31.280797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909fd6c-c8a0-48fb-bb71-ed84b45acf36 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:31.414486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 146/292] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:31.421155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7af6b-c3ed-4a2b-beca-521d189d252d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:31.552681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7af6b-c3ed-4a2b-beca-521d189d252d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:31.589747 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d3b8d-0b73-4a3e-b134-31fdcd3a0213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:31.590919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d3b8d-0b73-4a3e-b134-31fdcd3a0213 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:31.591201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d3b8d-0b73-4a3e-b134-31fdcd3a0213 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:31.591474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d3b8d-0b73-4a3e-b134-31fdcd3a0213 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:31.592640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d3b8d-0b73-4a3e-b134-31fdcd3a0213 None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:31.594113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d3b8d-0b73-4a3e-b134-31fdcd3a0213 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:31.596091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 147/293] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:31 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:31.601974 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909fd6c-c8a0-48fb-bb71-ed84b45acf36 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:31.615029 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:31.729446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909fd6c-c8a0-48fb-bb71-ed84b45acf36 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:31.782877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456ab64-32d9-4418-bc90-691c0def2f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:31.783503 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456ab64-32d9-4418-bc90-691c0def2f5f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:31.783843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456ab64-32d9-4418-bc90-691c0def2f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:31.784115 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456ab64-32d9-4418-bc90-691c0def2f5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:31.784960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456ab64-32d9-4418-bc90-691c0def2f5f None admin] RBAC: Adding query filter params (role.id=a21446fa03b24a5ebbaf61a4827146e7, scope.project.id=4fd381b007244ca79e5e671f37551f9a, user.id=f875a07e44594f3c97fe30c565954cc8) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:31.785294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456ab64-32d9-4418-bc90-691c0def2f5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:31.786737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456ab64-32d9-4418-bc90-691c0def2f5f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:31.798663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 147/294] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:31 2022] GET /identity/v3/role_assignments?user.id=f875a07e44594f3c97fe30c565954cc8&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:31.911397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68cbf-3c2e-4373-b6df-8bd735356ae4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:31.911727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68cbf-3c2e-4373-b6df-8bd735356ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:31.911945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc68cbf-3c2e-4373-b6df-8bd735356ae4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:31.913360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 148/295] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:31.919244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66785405-8bf3-47b3-8560-44755dffa646 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:31.919565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66785405-8bf3-47b3-8560-44755dffa646 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:31.919797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66785405-8bf3-47b3-8560-44755dffa646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:31.948516 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-66785405-8bf3-47b3-8560-44755dffa646 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:31.950331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-66785405-8bf3-47b3-8560-44755dffa646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:32.018160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df8567-21f4-4e27-a8af-c4009bc98079 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.018656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df8567-21f4-4e27-a8af-c4009bc98079 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.018759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df8567-21f4-4e27-a8af-c4009bc98079 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.020303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 149/296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:32.025486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b6b43-8309-42f8-a706-3c9098a190ef None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.025767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b6b43-8309-42f8-a706-3c9098a190ef None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.026041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b6b43-8309-42f8-a706-3c9098a190ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.042297 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 148/297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:32.050718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-097b6b43-8309-42f8-a706-3c9098a190ef None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:32.051916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-097b6b43-8309-42f8-a706-3c9098a190ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:32.067739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66785405-8bf3-47b3-8560-44755dffa646 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:32.073501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:32.076925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:32.145625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 150/298] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:32.179421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b6b43-8309-42f8-a706-3c9098a190ef None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:32.188855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66785405-8bf3-47b3-8560-44755dffa646 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:32.232830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd50fc9-bc06-4ec8-bdcc-24ce974c2837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:32.233840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50fc9-bc06-4ec8-bdcc-24ce974c2837 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.234328 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50fc9-bc06-4ec8-bdcc-24ce974c2837 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.234798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50fc9-bc06-4ec8-bdcc-24ce974c2837 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.236157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd50fc9-bc06-4ec8-bdcc-24ce974c2837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:32.239813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd50fc9-bc06-4ec8-bdcc-24ce974c2837 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:32.242063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 149/299] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:32.252167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd50fc9-bc06-4ec8-bdcc-24ce974c2837 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:32.311510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b6b43-8309-42f8-a706-3c9098a190ef None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:32.338652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:32.356889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba6014-8507-4674-bb6b-b818e216f14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:32.358034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6014-8507-4674-bb6b-b818e216f14a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.358517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6014-8507-4674-bb6b-b818e216f14a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.358990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba6014-8507-4674-bb6b-b818e216f14a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.376282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba6014-8507-4674-bb6b-b818e216f14a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:32.379314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd50fc9-bc06-4ec8-bdcc-24ce974c2837 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-54ba6014-8507-4674-bb6b-b818e216f14a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:32.382224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:32.383116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:32.383947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:32.386824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 151/300] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:32.392414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba6014-8507-4674-bb6b-b818e216f14a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:32.407496 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:32.421759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd218f78-868d-4996-8dde-d99e5b2c3f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:32.421948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218f78-868d-4996-8dde-d99e5b2c3f95 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.422181 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218f78-868d-4996-8dde-d99e5b2c3f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.422454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218f78-868d-4996-8dde-d99e5b2c3f95 None admin] PATH_INFO: `/v3/groups` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.423124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd218f78-868d-4996-8dde-d99e5b2c3f95 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:32.425496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd218f78-868d-4996-8dde-d99e5b2c3f95 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:32.501146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba6014-8507-4674-bb6b-b818e216f14a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:32.511241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 150/301] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 05:19:32 2022] POST /identity/v3/groups => generated 229 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:19:32.513533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6f2ee-57ea-4b47-b492-4e5d43741528 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.514088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6f2ee-57ea-4b47-b492-4e5d43741528 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.514610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6f2ee-57ea-4b47-b492-4e5d43741528 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.516374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 151/302] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:32.527107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343ba82-482f-4808-867c-34d7fada515c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.529233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343ba82-482f-4808-867c-34d7fada515c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.529233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343ba82-482f-4808-867c-34d7fada515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.546684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b3df7-8054-40d2-a11d-c28d8f5bedea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:32.547649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b3df7-8054-40d2-a11d-c28d8f5bedea None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.548064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b3df7-8054-40d2-a11d-c28d8f5bedea None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.548521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b3df7-8054-40d2-a11d-c28d8f5bedea None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.548910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c343ba82-482f-4808-867c-34d7fada515c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:32.549680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b3df7-8054-40d2-a11d-c28d8f5bedea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:32.550147 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b3df7-8054-40d2-a11d-c28d8f5bedea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:32.550256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c343ba82-482f-4808-867c-34d7fada515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:32.551848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b3df7-8054-40d2-a11d-c28d8f5bedea None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:32.563315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 152/303] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:32.569061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b3df7-8054-40d2-a11d-c28d8f5bedea None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:32.646146 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 152/304] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:32.658634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:32.670635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343ba82-482f-4808-867c-34d7fada515c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:32.703781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b3df7-8054-40d2-a11d-c28d8f5bedea None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:32.744679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133026e-d2cb-4ed6-b4ae-ebcd9d1636bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:32.744904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:32.745347 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133026e-d2cb-4ed6-b4ae-ebcd9d1636bf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.745421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133026e-d2cb-4ed6-b4ae-ebcd9d1636bf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.745656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133026e-d2cb-4ed6-b4ae-ebcd9d1636bf None admin] PATH_INFO: `/v3/users/f15a6d2f4eca408895563a7b97b0eb6c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.760361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133026e-d2cb-4ed6-b4ae-ebcd9d1636bf None admin] RBAC: Authorizing `identity:get_user(user_id=f15a6d2f4eca408895563a7b97b0eb6c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:32.761873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133026e-d2cb-4ed6-b4ae-ebcd9d1636bf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:32.764067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 153/305] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:32 2022] GET /identity/v3/users/f15a6d2f4eca408895563a7b97b0eb6c => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:32.765113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99879587-d0d5-4e74-92cf-03fb3d401598 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.765422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99879587-d0d5-4e74-92cf-03fb3d401598 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.765694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99879587-d0d5-4e74-92cf-03fb3d401598 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.767070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 154/306] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:32.771585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99879587-d0d5-4e74-92cf-03fb3d401598 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:32.797451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343ba82-482f-4808-867c-34d7fada515c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:32.837826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176199d-50e6-47ec-9725-cd6dfdb73318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:32.838474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176199d-50e6-47ec-9725-cd6dfdb73318 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.838756 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176199d-50e6-47ec-9725-cd6dfdb73318 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.839031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176199d-50e6-47ec-9725-cd6dfdb73318 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.849564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176199d-50e6-47ec-9725-cd6dfdb73318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e176199d-50e6-47ec-9725-cd6dfdb73318 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:32.854964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:32.856369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:32.857309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 153/307] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:32.858586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d279e-16d3-4e73-8390-c574ab5cfae6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.858586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d279e-16d3-4e73-8390-c574ab5cfae6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.858740 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d279e-16d3-4e73-8390-c574ab5cfae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.876935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9e5d279e-16d3-4e73-8390-c574ab5cfae6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:32.878161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9e5d279e-16d3-4e73-8390-c574ab5cfae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:32.883913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99879587-d0d5-4e74-92cf-03fb3d401598 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:32.916262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:32.922911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d898a75-e15f-4d1e-a126-94c1b740873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:32.923697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898a75-e15f-4d1e-a126-94c1b740873b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:32.923964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898a75-e15f-4d1e-a126-94c1b740873b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:32.940071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898a75-e15f-4d1e-a126-94c1b740873b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:32.940071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d898a75-e15f-4d1e-a126-94c1b740873b None admin] RBAC: Adding query filter params (role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6, user.id=f15a6d2f4eca408895563a7b97b0eb6c, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:32.940071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d898a75-e15f-4d1e-a126-94c1b740873b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:32.940071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d898a75-e15f-4d1e-a126-94c1b740873b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:32.940071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 155/308] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 05:19:32 2022] GET /identity/v3/role_assignments?user.id=f15a6d2f4eca408895563a7b97b0eb6c&scope.system=all&role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:32.940071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d898a75-e15f-4d1e-a126-94c1b740873b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:32.961619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 154/309] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:32.986762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d279e-16d3-4e73-8390-c574ab5cfae6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:33.049483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:33.064943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d898a75-e15f-4d1e-a126-94c1b740873b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:33.105590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbfbfb-1fc4-4981-b5bf-4ad87224f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:33.107557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbfbfb-1fc4-4981-b5bf-4ad87224f4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:33.108148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbfbfb-1fc4-4981-b5bf-4ad87224f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:33.108600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbfbfb-1fc4-4981-b5bf-4ad87224f4e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:33.109547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbfbfb-1fc4-4981-b5bf-4ad87224f4e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:33.110031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbfbfb-1fc4-4981-b5bf-4ad87224f4e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:33.111000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d279e-16d3-4e73-8390-c574ab5cfae6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:33.111837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbfbfb-1fc4-4981-b5bf-4ad87224f4e6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:33.121795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 156/310] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:33.127451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbfbfb-1fc4-4981-b5bf-4ad87224f4e6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:33.148688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fce04c-7bc0-4e91-b6a9-b9346fde684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:33.149525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fce04c-7bc0-4e91-b6a9-b9346fde684f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:33.149872 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fce04c-7bc0-4e91-b6a9-b9346fde684f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:33.150253 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fce04c-7bc0-4e91-b6a9-b9346fde684f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:33.170408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fce04c-7bc0-4e91-b6a9-b9346fde684f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b1fce04c-7bc0-4e91-b6a9-b9346fde684f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:33.176079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:33.176981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:33.177823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 155/311] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:33.183381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fce04c-7bc0-4e91-b6a9-b9346fde684f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:33.202312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:33.263020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbfbfb-1fc4-4981-b5bf-4ad87224f4e6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:33.303279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a4516-e19b-4ed1-8d8d-a754ec91bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:33.304178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a4516-e19b-4ed1-8d8d-a754ec91bf31 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:33.304454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a4516-e19b-4ed1-8d8d-a754ec91bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:33.304721 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a4516-e19b-4ed1-8d8d-a754ec91bf31 None admin] PATH_INFO: `/v3/users/16143d22933f41c3a40cef1ba110995f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:33.306015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a4516-e19b-4ed1-8d8d-a754ec91bf31 None admin] RBAC: Authorizing `identity:get_user(user_id=16143d22933f41c3a40cef1ba110995f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:33.307712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a4516-e19b-4ed1-8d8d-a754ec91bf31 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:33.311281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 157/312] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:33 2022] GET /identity/v3/users/16143d22933f41c3a40cef1ba110995f => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:33.316588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a4516-e19b-4ed1-8d8d-a754ec91bf31 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:33.329654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fce04c-7bc0-4e91-b6a9-b9346fde684f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:33.342073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:33.367757 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df0820-ca9e-45ea-9c0c-0fcdc7475709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:33.368708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df0820-ca9e-45ea-9c0c-0fcdc7475709 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:33.369320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df0820-ca9e-45ea-9c0c-0fcdc7475709 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:33.369784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df0820-ca9e-45ea-9c0c-0fcdc7475709 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:33.370707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df0820-ca9e-45ea-9c0c-0fcdc7475709 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:33.371347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df0820-ca9e-45ea-9c0c-0fcdc7475709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:33.378279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df0820-ca9e-45ea-9c0c-0fcdc7475709 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:33.393157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 156/313] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:33.394387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df0820-ca9e-45ea-9c0c-0fcdc7475709 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:33.445799 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a4516-e19b-4ed1-8d8d-a754ec91bf31 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:33.475802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:33.494286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d6762-6164-4810-a6a9-f4ddb2cc8cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:33.495420 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6762-6164-4810-a6a9-f4ddb2cc8cf1 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:33.495702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6762-6164-4810-a6a9-f4ddb2cc8cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:33.495972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d6762-6164-4810-a6a9-f4ddb2cc8cf1 None admin] PATH_INFO: `/v3/system/users/16143d22933f41c3a40cef1ba110995f/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:33.498619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d6762-6164-4810-a6a9-f4ddb2cc8cf1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=16143d22933f41c3a40cef1ba110995f, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:33.500871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d6762-6164-4810-a6a9-f4ddb2cc8cf1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:33.520841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df0820-ca9e-45ea-9c0c-0fcdc7475709 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:33.555921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8796b2-8fdf-4a08-8b9e-3c4dc4477099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:33.556594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8796b2-8fdf-4a08-8b9e-3c4dc4477099 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:33.556880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8796b2-8fdf-4a08-8b9e-3c4dc4477099 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:33.557257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8796b2-8fdf-4a08-8b9e-3c4dc4477099 None admin] PATH_INFO: `/v3/users/2df9676b2e714d8a8640af5778b1ad01` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:33.558447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8796b2-8fdf-4a08-8b9e-3c4dc4477099 None admin] RBAC: Authorizing `identity:get_user(user_id=2df9676b2e714d8a8640af5778b1ad01)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:33.560735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8796b2-8fdf-4a08-8b9e-3c4dc4477099 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:33.562400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 157/314] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:33 2022] GET /identity/v3/users/2df9676b2e714d8a8640af5778b1ad01 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:33.567702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8796b2-8fdf-4a08-8b9e-3c4dc4477099 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:33.593200 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 158/315] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 05:19:33 2022] PUT /identity/v3/system/users/16143d22933f41c3a40cef1ba110995f/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:19:33.624800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:33.695426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8796b2-8fdf-4a08-8b9e-3c4dc4477099 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:33.737407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae39f29-f8f0-4b2b-82c6-e8371875f7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:33.738344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae39f29-f8f0-4b2b-82c6-e8371875f7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:33.738765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae39f29-f8f0-4b2b-82c6-e8371875f7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:33.739171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae39f29-f8f0-4b2b-82c6-e8371875f7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:33.814592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae39f29-f8f0-4b2b-82c6-e8371875f7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:33.816067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae39f29-f8f0-4b2b-82c6-e8371875f7c4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:33.857896 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:33.918830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 158/316] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:19:33.924317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d6762-6164-4810-a6a9-f4ddb2cc8cf1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:34.028676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d6762-6164-4810-a6a9-f4ddb2cc8cf1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:34.072331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be7ba0-a424-45cf-a1e8-bacd32e6f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:34.072936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7ba0-a424-45cf-a1e8-bacd32e6f157 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:34.073193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7ba0-a424-45cf-a1e8-bacd32e6f157 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:34.073464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7ba0-a424-45cf-a1e8-bacd32e6f157 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:34.075176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be7ba0-a424-45cf-a1e8-bacd32e6f157 None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:34.076664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be7ba0-a424-45cf-a1e8-bacd32e6f157 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:34.078656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 159/317] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:33 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:34.084535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae39f29-f8f0-4b2b-82c6-e8371875f7c4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:34.192736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae39f29-f8f0-4b2b-82c6-e8371875f7c4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:34.228161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebc9af-dcb3-4b7b-9502-4ad436278660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:34.229169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebc9af-dcb3-4b7b-9502-4ad436278660 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:34.229648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebc9af-dcb3-4b7b-9502-4ad436278660 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:34.230110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebc9af-dcb3-4b7b-9502-4ad436278660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:34.231115 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebc9af-dcb3-4b7b-9502-4ad436278660 None admin] RBAC: Adding query filter params (role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6, scope.project.id=4fd381b007244ca79e5e671f37551f9a, user.id=2df9676b2e714d8a8640af5778b1ad01) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:34.231700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebc9af-dcb3-4b7b-9502-4ad436278660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:34.233438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebc9af-dcb3-4b7b-9502-4ad436278660 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:34.239940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 159/318] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:19:34 2022] GET /identity/v3/role_assignments?user.id=2df9676b2e714d8a8640af5778b1ad01&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:34.653454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd5605-8712-48bd-b4ea-7e24e86e5d4c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:34.653840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd5605-8712-48bd-b4ea-7e24e86e5d4c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:34.654017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd5605-8712-48bd-b4ea-7e24e86e5d4c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:34.655401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 160/319] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:34.661289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03c908-baca-445a-985c-af5673ef18df None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:34.661649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03c908-baca-445a-985c-af5673ef18df None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:34.662147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03c908-baca-445a-985c-af5673ef18df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:34.669676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:34.681536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3b03c908-baca-445a-985c-af5673ef18df None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:34.682944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3b03c908-baca-445a-985c-af5673ef18df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:34.765156 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 160/320] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:34.785019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd5605-8712-48bd-b4ea-7e24e86e5d4c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:34.853275 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:34.905100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd5605-8712-48bd-b4ea-7e24e86e5d4c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:34.942588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa8943-f829-4333-a06b-aba5d5a74607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:34.943243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa8943-f829-4333-a06b-aba5d5a74607 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:34.943519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa8943-f829-4333-a06b-aba5d5a74607 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:34.943787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa8943-f829-4333-a06b-aba5d5a74607 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:34.945031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa8943-f829-4333-a06b-aba5d5a74607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:34.946637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa8943-f829-4333-a06b-aba5d5a74607 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:34.954381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 161/321] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:34.955942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03c908-baca-445a-985c-af5673ef18df None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:35.081177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83792697-fe43-4532-8fca-2d321629a9c5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:35.082101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83792697-fe43-4532-8fca-2d321629a9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:35.082439 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83792697-fe43-4532-8fca-2d321629a9c5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:35.083942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 162/322] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:35.088957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb9cb-41fe-4fc5-aafb-18e9e53dff76 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:35.089297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb9cb-41fe-4fc5-aafb-18e9e53dff76 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:35.089577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdb9cb-41fe-4fc5-aafb-18e9e53dff76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:35.098097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03c908-baca-445a-985c-af5673ef18df None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:35.108249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-40cdb9cb-41fe-4fc5-aafb-18e9e53dff76 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:35.109615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-40cdb9cb-41fe-4fc5-aafb-18e9e53dff76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:35.145213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e55fa-e735-40fd-95e7-7d1686e176a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:35.145840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e55fa-e735-40fd-95e7-7d1686e176a2 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:35.146119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e55fa-e735-40fd-95e7-7d1686e176a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:35.146388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e55fa-e735-40fd-95e7-7d1686e176a2 None admin] PATH_INFO: `/v3/groups` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:35.147068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e55fa-e735-40fd-95e7-7d1686e176a2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:35.148731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e55fa-e735-40fd-95e7-7d1686e176a2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:35.160782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:35.185878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 163/323] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:35.208673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdb9cb-41fe-4fc5-aafb-18e9e53dff76 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:35.267176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 161/324] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 05:19:34 2022] POST /identity/v3/groups => generated 226 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:19:35.280861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:35.344568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdb9cb-41fe-4fc5-aafb-18e9e53dff76 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:35.390049 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37764183-0cc6-4fc5-9b57-351d73113c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:35.390722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37764183-0cc6-4fc5-9b57-351d73113c81 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:35.391002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37764183-0cc6-4fc5-9b57-351d73113c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:35.391273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37764183-0cc6-4fc5-9b57-351d73113c81 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:35.409506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37764183-0cc6-4fc5-9b57-351d73113c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-37764183-0cc6-4fc5-9b57-351d73113c81 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:35.414751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:35.415657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:35.416455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 164/325] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:35.422918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e55fa-e735-40fd-95e7-7d1686e176a2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:35.541084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e55fa-e735-40fd-95e7-7d1686e176a2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:35.577807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b4d63-0c99-48aa-8323-d7d6c1fcd0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:35.578799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b4d63-0c99-48aa-8323-d7d6c1fcd0fa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:35.579282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b4d63-0c99-48aa-8323-d7d6c1fcd0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:35.579775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b4d63-0c99-48aa-8323-d7d6c1fcd0fa None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:35.580654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b4d63-0c99-48aa-8323-d7d6c1fcd0fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:35.580961 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b4d63-0c99-48aa-8323-d7d6c1fcd0fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:35.582512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b4d63-0c99-48aa-8323-d7d6c1fcd0fa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:35.592284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 162/326] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:35.597551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37764183-0cc6-4fc5-9b57-351d73113c81 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:35.710405 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37764183-0cc6-4fc5-9b57-351d73113c81 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:35.725962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0807-af1f-4169-a0a6-0c2c4fe05342 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:35.726246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0807-af1f-4169-a0a6-0c2c4fe05342 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:35.726524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0807-af1f-4169-a0a6-0c2c4fe05342 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:35.728137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 163/327] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:35.731911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:35.734537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b233bfb-1d18-4473-80ee-2f489b57a185 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:35.734825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b233bfb-1d18-4473-80ee-2f489b57a185 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:35.735192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b233bfb-1d18-4473-80ee-2f489b57a185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:35.761465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e561c8-4a2f-44ee-8feb-15a268e80351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:35.762438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e561c8-4a2f-44ee-8feb-15a268e80351 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:35.762696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e561c8-4a2f-44ee-8feb-15a268e80351 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:35.762794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6b233bfb-1d18-4473-80ee-2f489b57a185 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:35.763054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e561c8-4a2f-44ee-8feb-15a268e80351 None admin] PATH_INFO: `/v3/users/f15a6d2f4eca408895563a7b97b0eb6c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:35.763972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6b233bfb-1d18-4473-80ee-2f489b57a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:35.764977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e561c8-4a2f-44ee-8feb-15a268e80351 None admin] RBAC: Authorizing `identity:get_user(user_id=f15a6d2f4eca408895563a7b97b0eb6c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:35.766484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e561c8-4a2f-44ee-8feb-15a268e80351 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:35.769591 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 165/328] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:35 2022] GET /identity/v3/users/f15a6d2f4eca408895563a7b97b0eb6c => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:35.775089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e561c8-4a2f-44ee-8feb-15a268e80351 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:35.861211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 164/329] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:35.861211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:35.881664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b233bfb-1d18-4473-80ee-2f489b57a185 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:35.893541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e561c8-4a2f-44ee-8feb-15a268e80351 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:35.967065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f6c4c-46fe-46af-aa3a-ab60dc6f97a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:35.967669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f6c4c-46fe-46af-aa3a-ab60dc6f97a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:35.967948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f6c4c-46fe-46af-aa3a-ab60dc6f97a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:35.968218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f6c4c-46fe-46af-aa3a-ab60dc6f97a7 None admin] PATH_INFO: `/v3/system/users/f15a6d2f4eca408895563a7b97b0eb6c/roles/a1a15b7daf9f4fa697a9d35e7ce7dab6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:35.970461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f6c4c-46fe-46af-aa3a-ab60dc6f97a7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f15a6d2f4eca408895563a7b97b0eb6c, role_id=a1a15b7daf9f4fa697a9d35e7ce7dab6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:35.972374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f6c4c-46fe-46af-aa3a-ab60dc6f97a7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:36.005909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b233bfb-1d18-4473-80ee-2f489b57a185 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:36.046334 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b2057-99c0-48ef-ad93-6ca68cc2ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:36.047382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b2057-99c0-48ef-ad93-6ca68cc2ef6d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:36.047858 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b2057-99c0-48ef-ad93-6ca68cc2ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:36.048330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b2057-99c0-48ef-ad93-6ca68cc2ef6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:36.056167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 166/330] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 05:19:35 2022] PUT /identity/v3/system/users/f15a6d2f4eca408895563a7b97b0eb6c/roles/a1a15b7daf9f4fa697a9d35e7ce7dab6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:36.063672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b2057-99c0-48ef-ad93-6ca68cc2ef6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d31b2057-99c0-48ef-ad93-6ca68cc2ef6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:36.069521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:36.070405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:36.071213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:36.073626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 165/331] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:36.080841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f6c4c-46fe-46af-aa3a-ab60dc6f97a7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:36.153940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:36.228061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f6c4c-46fe-46af-aa3a-ab60dc6f97a7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:36.270218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0baec-9838-4307-84c4-8e4fc96e6f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:36.271133 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0baec-9838-4307-84c4-8e4fc96e6f2a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:36.271559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0baec-9838-4307-84c4-8e4fc96e6f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:36.271974 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0baec-9838-4307-84c4-8e4fc96e6f2a None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:36.272906 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0baec-9838-4307-84c4-8e4fc96e6f2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:36.273394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0baec-9838-4307-84c4-8e4fc96e6f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:36.274910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0baec-9838-4307-84c4-8e4fc96e6f2a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:36.287014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 167/332] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:36.294373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b2057-99c0-48ef-ad93-6ca68cc2ef6d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:36.374106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:36.432477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b2057-99c0-48ef-ad93-6ca68cc2ef6d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:36.472876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b45dfe-0678-4c47-b25c-1c2bea39f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:36.473790 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b45dfe-0678-4c47-b25c-1c2bea39f023 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:36.474222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b45dfe-0678-4c47-b25c-1c2bea39f023 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:36.474662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b45dfe-0678-4c47-b25c-1c2bea39f023 None admin] PATH_INFO: `/v3/users/16143d22933f41c3a40cef1ba110995f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:36.475991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b45dfe-0678-4c47-b25c-1c2bea39f023 None admin] RBAC: Authorizing `identity:get_user(user_id=16143d22933f41c3a40cef1ba110995f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:36.477629 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b45dfe-0678-4c47-b25c-1c2bea39f023 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:36.479766 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 166/333] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:36 2022] GET /identity/v3/users/16143d22933f41c3a40cef1ba110995f => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:36.485950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0baec-9838-4307-84c4-8e4fc96e6f2a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:36.628003 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0baec-9838-4307-84c4-8e4fc96e6f2a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:36.639702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:36.666942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae382b-edae-4710-9cce-271ff8f2c6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:36.667572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae382b-edae-4710-9cce-271ff8f2c6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:36.667851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae382b-edae-4710-9cce-271ff8f2c6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:36.668211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae382b-edae-4710-9cce-271ff8f2c6d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:36.669454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae382b-edae-4710-9cce-271ff8f2c6d0 None admin] RBAC: Adding query filter params (role.id=a21446fa03b24a5ebbaf61a4827146e7, user.id=16143d22933f41c3a40cef1ba110995f, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:36.669767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae382b-edae-4710-9cce-271ff8f2c6d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:36.671233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae382b-edae-4710-9cce-271ff8f2c6d0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:36.688980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 168/334] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 05:19:36 2022] GET /identity/v3/role_assignments?user.id=16143d22933f41c3a40cef1ba110995f&scope.system=all&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:38.331323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc4a4-f76d-4793-acd1-c9ae0463ee22 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:38.331826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc4a4-f76d-4793-acd1-c9ae0463ee22 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:38.331925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cc4a4-f76d-4793-acd1-c9ae0463ee22 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:38.333496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 167/335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:38.338485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b8974-bc0b-44e4-8c22-c978ce2bc2b7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:38.338875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b8974-bc0b-44e4-8c22-c978ce2bc2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:38.339076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b8974-bc0b-44e4-8c22-c978ce2bc2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:38.366119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3b4b8974-bc0b-44e4-8c22-c978ce2bc2b7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:38.367321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3b4b8974-bc0b-44e4-8c22-c978ce2bc2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:38.452879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 169/336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:38.481339 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d80d9-8807-45f3-ba27-78953968cb85 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:38.481948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d80d9-8807-45f3-ba27-78953968cb85 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:38.482418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d80d9-8807-45f3-ba27-78953968cb85 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:38.483957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 168/337] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:38.489861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316089f9-da54-4cf6-96b4-ce3a236e71af None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:38.490149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316089f9-da54-4cf6-96b4-ce3a236e71af None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:38.490423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316089f9-da54-4cf6-96b4-ce3a236e71af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:38.501699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d80d9-8807-45f3-ba27-78953968cb85 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:38.518108 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-316089f9-da54-4cf6-96b4-ce3a236e71af None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:38.519316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-316089f9-da54-4cf6-96b4-ce3a236e71af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:38.631754 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 170/338] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:38.663100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d80d9-8807-45f3-ba27-78953968cb85 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:38.669270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316089f9-da54-4cf6-96b4-ce3a236e71af None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:38.683787 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:38.710689 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbf329-12bf-4369-8a55-ca43248361bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:38.711260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf329-12bf-4369-8a55-ca43248361bf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:38.711542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf329-12bf-4369-8a55-ca43248361bf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:38.711813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbf329-12bf-4369-8a55-ca43248361bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:38.731073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbf329-12bf-4369-8a55-ca43248361bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0fdbf329-12bf-4369-8a55-ca43248361bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:38.736121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:38.737028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:38.737871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 169/339] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:38.739036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e495a-2e11-4433-94d8-7a50f2af2267 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:38.739134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e495a-2e11-4433-94d8-7a50f2af2267 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:38.739344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e495a-2e11-4433-94d8-7a50f2af2267 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:38.740593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 170/340] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:38.745406 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e495a-2e11-4433-94d8-7a50f2af2267 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:38.745918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:38.891061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e495a-2e11-4433-94d8-7a50f2af2267 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:38.900835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316089f9-da54-4cf6-96b4-ce3a236e71af None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:38.946449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379d7e0-1282-418d-998d-3738d6c9bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:38.947096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379d7e0-1282-418d-998d-3738d6c9bbdf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:38.947374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379d7e0-1282-418d-998d-3738d6c9bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:38.947653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379d7e0-1282-418d-998d-3738d6c9bbdf None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:38.948375 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379d7e0-1282-418d-998d-3738d6c9bbdf None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:38.948679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379d7e0-1282-418d-998d-3738d6c9bbdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:38.953195 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379d7e0-1282-418d-998d-3738d6c9bbdf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:38.958321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba64a26-c312-4646-9e9a-6ae618404ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:38.959260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba64a26-c312-4646-9e9a-6ae618404ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:38.959787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba64a26-c312-4646-9e9a-6ae618404ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:38.960312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba64a26-c312-4646-9e9a-6ae618404ef9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:38.962688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 171/341] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:38.967543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29c4c3-95ff-41bd-99d3-fc3a4e21c46e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:38.967543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29c4c3-95ff-41bd-99d3-fc3a4e21c46e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:38.967543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29c4c3-95ff-41bd-99d3-fc3a4e21c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:38.981773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba64a26-c312-4646-9e9a-6ae618404ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:38.985933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2a29c4c3-95ff-41bd-99d3-fc3a4e21c46e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:38.987137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2a29c4c3-95ff-41bd-99d3-fc3a4e21c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cba64a26-c312-4646-9e9a-6ae618404ef9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:38.987843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:38.988765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:38.989588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:38.992179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 171/342] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:38.997250 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba64a26-c312-4646-9e9a-6ae618404ef9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:39.018540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:39.062662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 172/343] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:39.063945 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29c4c3-95ff-41bd-99d3-fc3a4e21c46e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:39.125477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:39.143375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba64a26-c312-4646-9e9a-6ae618404ef9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:39.181822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf595fde-d621-4f15-b8ef-88cf6eff19d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:39.182462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf595fde-d621-4f15-b8ef-88cf6eff19d6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:39.182744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf595fde-d621-4f15-b8ef-88cf6eff19d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:39.183014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf595fde-d621-4f15-b8ef-88cf6eff19d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:39.188426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29c4c3-95ff-41bd-99d3-fc3a4e21c46e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:39.226983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ec1a4-5795-4f3e-b507-3d653f411bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:39.228116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ec1a4-5795-4f3e-b507-3d653f411bea None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:39.228595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ec1a4-5795-4f3e-b507-3d653f411bea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:39.229170 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ec1a4-5795-4f3e-b507-3d653f411bea None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:39.230085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ec1a4-5795-4f3e-b507-3d653f411bea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:39.231262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ec1a4-5795-4f3e-b507-3d653f411bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:39.232864 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ec1a4-5795-4f3e-b507-3d653f411bea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:39.242151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 173/344] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:39.243252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ec1a4-5795-4f3e-b507-3d653f411bea None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:39.258636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf595fde-d621-4f15-b8ef-88cf6eff19d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:39.260239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf595fde-d621-4f15-b8ef-88cf6eff19d6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:39.275012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:39.355161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ec1a4-5795-4f3e-b507-3d653f411bea None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:39.357568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:39.375382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 172/345] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:39.376320 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf595fde-d621-4f15-b8ef-88cf6eff19d6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:39.394615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ab534-0b81-40df-910d-ae22a549028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:39.395660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ab534-0b81-40df-910d-ae22a549028a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:39.396137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ab534-0b81-40df-910d-ae22a549028a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:39.396772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ab534-0b81-40df-910d-ae22a549028a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:39.409792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ab534-0b81-40df-910d-ae22a549028a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-709ab534-0b81-40df-910d-ae22a549028a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:39.416194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:39.417158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:39.418687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:39.421277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 174/346] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:39.422393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ab534-0b81-40df-910d-ae22a549028a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:39.561479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf595fde-d621-4f15-b8ef-88cf6eff19d6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:39.595701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:39.603782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35f729-af56-4ac6-800e-b07787cfe9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:39.611538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35f729-af56-4ac6-800e-b07787cfe9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:39.611538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35f729-af56-4ac6-800e-b07787cfe9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:39.611538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35f729-af56-4ac6-800e-b07787cfe9f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:39.611781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ab534-0b81-40df-910d-ae22a549028a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:39.653052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545b815-a6eb-4425-8834-040988e1a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:39.654443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545b815-a6eb-4425-8834-040988e1a07b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:39.654728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545b815-a6eb-4425-8834-040988e1a07b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:39.655006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545b815-a6eb-4425-8834-040988e1a07b None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:39.656304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545b815-a6eb-4425-8834-040988e1a07b None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:39.657792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545b815-a6eb-4425-8834-040988e1a07b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:39.659567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 175/347] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:39 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:39.660449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545b815-a6eb-4425-8834-040988e1a07b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:39.670680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:39.686249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35f729-af56-4ac6-800e-b07787cfe9f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:39.687950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35f729-af56-4ac6-800e-b07787cfe9f4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:39.788571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545b815-a6eb-4425-8834-040988e1a07b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:39.816788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 173/348] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:39.818577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6959e2-5a47-4989-9d8e-fec2343c6a27 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:39.819112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6959e2-5a47-4989-9d8e-fec2343c6a27 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:39.819577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6959e2-5a47-4989-9d8e-fec2343c6a27 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:39.821066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 174/349] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:39.822024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6959e2-5a47-4989-9d8e-fec2343c6a27 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:39.836343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892aadb-3d2e-4b83-8050-180fc3f49b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:39.837314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892aadb-3d2e-4b83-8050-180fc3f49b99 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:39.837813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892aadb-3d2e-4b83-8050-180fc3f49b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:39.838169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892aadb-3d2e-4b83-8050-180fc3f49b99 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:39.838977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892aadb-3d2e-4b83-8050-180fc3f49b99 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:39.839281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892aadb-3d2e-4b83-8050-180fc3f49b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:39.840927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892aadb-3d2e-4b83-8050-180fc3f49b99 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:39.853597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 176/350] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:39.853597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0367942-b410-4701-8069-c8b015bf149d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:39.853597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0367942-b410-4701-8069-c8b015bf149d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:39.853597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0367942-b410-4701-8069-c8b015bf149d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:39.853597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 177/351] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:39.854019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0367942-b410-4701-8069-c8b015bf149d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:39.882210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:39.941373 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:39.959410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6959e2-5a47-4989-9d8e-fec2343c6a27 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:39.986683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0367942-b410-4701-8069-c8b015bf149d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:40.005975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b36c-9ea5-415f-9dd2-d6cfc03b2c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:40.006627 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b36c-9ea5-415f-9dd2-d6cfc03b2c8a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.006905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b36c-9ea5-415f-9dd2-d6cfc03b2c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.007385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b36c-9ea5-415f-9dd2-d6cfc03b2c8a None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.014479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9b36c-9ea5-415f-9dd2-d6cfc03b2c8a None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:40.015953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9b36c-9ea5-415f-9dd2-d6cfc03b2c8a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:40.018832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 175/352] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:39 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:40.020012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bdde9-2c51-44bd-b3f6-bf248a7afe5c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.020291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bdde9-2c51-44bd-b3f6-bf248a7afe5c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.020560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bdde9-2c51-44bd-b3f6-bf248a7afe5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.026563 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcb6a0-cc17-40a9-84be-890c6b87854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:40.027220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcb6a0-cc17-40a9-84be-890c6b87854f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.027560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcb6a0-cc17-40a9-84be-890c6b87854f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.027836 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcb6a0-cc17-40a9-84be-890c6b87854f None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.029456 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcb6a0-cc17-40a9-84be-890c6b87854f None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:40.030960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcb6a0-cc17-40a9-84be-890c6b87854f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:40.032769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 178/353] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:39 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:40.033398 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcb6a0-cc17-40a9-84be-890c6b87854f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:40.046378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ea3bdde9-2c51-44bd-b3f6-bf248a7afe5c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:40.047992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ea3bdde9-2c51-44bd-b3f6-bf248a7afe5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:40.129809 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 176/354] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:40.132077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad76e5-e3f4-4560-9711-5cf75b80825d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.132364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad76e5-e3f4-4560-9711-5cf75b80825d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.132630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad76e5-e3f4-4560-9711-5cf75b80825d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.140982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:40.153094 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e5ad76e5-e3f4-4560-9711-5cf75b80825d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:40.156384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e5ad76e5-e3f4-4560-9711-5cf75b80825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:40.161112 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcb6a0-cc17-40a9-84be-890c6b87854f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:40.201615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a646c5-90be-40db-9147-2a0851e1ea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:40.202246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a646c5-90be-40db-9147-2a0851e1ea73 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.202526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a646c5-90be-40db-9147-2a0851e1ea73 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.202801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a646c5-90be-40db-9147-2a0851e1ea73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.239107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 177/355] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:40.242477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4445b2-46e2-4115-b13d-9de5447f499b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.242836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4445b2-46e2-4115-b13d-9de5447f499b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.243292 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4445b2-46e2-4115-b13d-9de5447f499b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.245079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 178/356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:40.245430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4445b2-46e2-4115-b13d-9de5447f499b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:40.260853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:40.286585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a646c5-90be-40db-9147-2a0851e1ea73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:40.288050 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a646c5-90be-40db-9147-2a0851e1ea73 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:40.369808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4445b2-46e2-4115-b13d-9de5447f499b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:40.389750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:40.408159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 179/357] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:40.409769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a646c5-90be-40db-9147-2a0851e1ea73 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:40.412339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932df18-5f6f-425c-bcf7-5764cc404bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:40.413314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932df18-5f6f-425c-bcf7-5764cc404bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.413532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932df18-5f6f-425c-bcf7-5764cc404bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.418822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932df18-5f6f-425c-bcf7-5764cc404bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.418822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932df18-5f6f-425c-bcf7-5764cc404bc7 None admin] RBAC: Adding query filter params (group.id=6ba1f72a208d4d44b16d7c41991f009f, role.id=a21446fa03b24a5ebbaf61a4827146e7, scope.project.id=86802e43046f4a66bdee6d53a4239a87) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:40.418822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932df18-5f6f-425c-bcf7-5764cc404bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:40.418822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932df18-5f6f-425c-bcf7-5764cc404bc7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:40.422957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 179/358] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 05:19:40 2022] GET /identity/v3/role_assignments?group.id=6ba1f72a208d4d44b16d7c41991f009f&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:40.423771 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932df18-5f6f-425c-bcf7-5764cc404bc7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:40.536670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:40.558011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a646c5-90be-40db-9147-2a0851e1ea73 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:40.571336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932df18-5f6f-425c-bcf7-5764cc404bc7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:40.600477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d95537-7266-4107-838c-a74ae242b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:40.601326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95537-7266-4107-838c-a74ae242b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.601609 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95537-7266-4107-838c-a74ae242b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.601933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95537-7266-4107-838c-a74ae242b7a7 None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.603104 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d95537-7266-4107-838c-a74ae242b7a7 None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:40.604556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d95537-7266-4107-838c-a74ae242b7a7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:40.606921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 180/359] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:40 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:40.607896 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed760-d873-4f0f-a8db-6ea88549ad18 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.608181 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed760-d873-4f0f-a8db-6ea88549ad18 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.608450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed760-d873-4f0f-a8db-6ea88549ad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.613438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed038-9992-497d-b97f-c77f10106233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:40.614093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed038-9992-497d-b97f-c77f10106233 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.614368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed038-9992-497d-b97f-c77f10106233 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.614639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ed038-9992-497d-b97f-c77f10106233 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.625882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ed038-9992-497d-b97f-c77f10106233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:40.628023 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-421ed760-d873-4f0f-a8db-6ea88549ad18 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:40.629442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-421ed760-d873-4f0f-a8db-6ea88549ad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e65ed038-9992-497d-b97f-c77f10106233 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:40.631397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:40.632280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 05:19:40.633089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:40.634145 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 180/360] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:40.634474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed038-9992-497d-b97f-c77f10106233 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:40.696714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:40.717033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 181/361] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:40.717811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ed760-d873-4f0f-a8db-6ea88549ad18 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:40.785849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ed038-9992-497d-b97f-c77f10106233 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:40.832121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99432-0058-45e5-8435-9ffbebb8437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:40.832768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99432-0058-45e5-8435-9ffbebb8437d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.833047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99432-0058-45e5-8435-9ffbebb8437d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.833349 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99432-0058-45e5-8435-9ffbebb8437d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.836222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:40.846364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ed760-d873-4f0f-a8db-6ea88549ad18 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:40.848762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d99432-0058-45e5-8435-9ffbebb8437d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-90d99432-0058-45e5-8435-9ffbebb8437d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:40.854817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:40.856314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:40.857416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 181/362] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:40.858697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99432-0058-45e5-8435-9ffbebb8437d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:40.891395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c82f54-7e44-42f4-b685-f292cd8cd8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:40.892048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82f54-7e44-42f4-b685-f292cd8cd8eb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:40.892325 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82f54-7e44-42f4-b685-f292cd8cd8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:40.892589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82f54-7e44-42f4-b685-f292cd8cd8eb None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:40.894161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c82f54-7e44-42f4-b685-f292cd8cd8eb None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:40.895203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c82f54-7e44-42f4-b685-f292cd8cd8eb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:40.896990 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 182/363] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:40 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:40.899567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c82f54-7e44-42f4-b685-f292cd8cd8eb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:40.961880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:40.992100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99432-0058-45e5-8435-9ffbebb8437d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:41.024692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c82f54-7e44-42f4-b685-f292cd8cd8eb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:41.035710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767743b8-ad8f-48b0-8fe9-aa120911f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:41.036340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767743b8-ad8f-48b0-8fe9-aa120911f129 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:41.036616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767743b8-ad8f-48b0-8fe9-aa120911f129 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:41.037012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767743b8-ad8f-48b0-8fe9-aa120911f129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:41.037842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767743b8-ad8f-48b0-8fe9-aa120911f129 None admin] RBAC: Adding query filter params (group.id=6ba1f72a208d4d44b16d7c41991f009f, role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7, scope.project.id=86802e43046f4a66bdee6d53a4239a87) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:41.038152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767743b8-ad8f-48b0-8fe9-aa120911f129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:41.039720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767743b8-ad8f-48b0-8fe9-aa120911f129 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:41.053381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 182/364] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 05:19:40 2022] GET /identity/v3/role_assignments?group.id=6ba1f72a208d4d44b16d7c41991f009f&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:41.054961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767743b8-ad8f-48b0-8fe9-aa120911f129 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:41.069597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc491d80-6fb3-4ba4-b975-a72e3e720abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:41.070470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc491d80-6fb3-4ba4-b975-a72e3e720abd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:41.070913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc491d80-6fb3-4ba4-b975-a72e3e720abd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:41.071321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc491d80-6fb3-4ba4-b975-a72e3e720abd None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:41.072187 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc491d80-6fb3-4ba4-b975-a72e3e720abd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:41.072660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc491d80-6fb3-4ba4-b975-a72e3e720abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:41.074367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc491d80-6fb3-4ba4-b975-a72e3e720abd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:41.084490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 183/365] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:41.085671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc491d80-6fb3-4ba4-b975-a72e3e720abd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:41.136501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:41.195020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767743b8-ad8f-48b0-8fe9-aa120911f129 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:41.208235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc491d80-6fb3-4ba4-b975-a72e3e720abd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:41.234113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:41.236524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e374f86-4958-4355-95f4-6b6bba16a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:41.237224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e374f86-4958-4355-95f4-6b6bba16a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:41.237507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e374f86-4958-4355-95f4-6b6bba16a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:41.238161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e374f86-4958-4355-95f4-6b6bba16a6e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:41.251614 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810ca0d-3500-4823-9bbf-ef74115eea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:41.251814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e374f86-4958-4355-95f4-6b6bba16a6e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:41.252383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810ca0d-3500-4823-9bbf-ef74115eea46 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:41.252664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810ca0d-3500-4823-9bbf-ef74115eea46 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:41.252929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810ca0d-3500-4823-9bbf-ef74115eea46 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:41.253712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810ca0d-3500-4823-9bbf-ef74115eea46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:41.254017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810ca0d-3500-4823-9bbf-ef74115eea46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:41.255383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810ca0d-3500-4823-9bbf-ef74115eea46 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9e374f86-4958-4355-95f4-6b6bba16a6e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:41.257430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:41.258487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 183/366] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:19:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:41.259781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e374f86-4958-4355-95f4-6b6bba16a6e8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:41.267716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 184/367] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:41.268613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810ca0d-3500-4823-9bbf-ef74115eea46 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:41.394330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e374f86-4958-4355-95f4-6b6bba16a6e8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:41.404521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810ca0d-3500-4823-9bbf-ef74115eea46 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:41.414588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:41.434725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe6b14-df43-4dfc-96c2-b517043fe6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:41.435725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6b14-df43-4dfc-96c2-b517043fe6ec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:41.436190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6b14-df43-4dfc-96c2-b517043fe6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:41.436827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe6b14-df43-4dfc-96c2-b517043fe6ec None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:41.438239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe6b14-df43-4dfc-96c2-b517043fe6ec None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:41.439883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe6b14-df43-4dfc-96c2-b517043fe6ec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:41.441611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ceab68-6862-4131-b31c-50afb33e164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:41.441921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 184/368] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:41 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:41.442257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceab68-6862-4131-b31c-50afb33e164d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:41.442537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceab68-6862-4131-b31c-50afb33e164d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:41.442811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceab68-6862-4131-b31c-50afb33e164d None admin] PATH_INFO: `/v3/users/f15a6d2f4eca408895563a7b97b0eb6c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:41.443512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe6b14-df43-4dfc-96c2-b517043fe6ec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:41.444049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ceab68-6862-4131-b31c-50afb33e164d None admin] RBAC: Authorizing `identity:get_user(user_id=f15a6d2f4eca408895563a7b97b0eb6c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:41.445514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ceab68-6862-4131-b31c-50afb33e164d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:41.447390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 185/369] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:19:41 2022] GET /identity/v3/users/f15a6d2f4eca408895563a7b97b0eb6c => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:41.448832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ceab68-6862-4131-b31c-50afb33e164d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:41.505368 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:41.556831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe6b14-df43-4dfc-96c2-b517043fe6ec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:41.563833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ceab68-6862-4131-b31c-50afb33e164d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:41.595780 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfeb9d-5c85-45db-b372-30fffaa0e597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:41.596693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfeb9d-5c85-45db-b372-30fffaa0e597 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:41.597199 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfeb9d-5c85-45db-b372-30fffaa0e597 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:41.597646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfeb9d-5c85-45db-b372-30fffaa0e597 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:41.598534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfeb9d-5c85-45db-b372-30fffaa0e597 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:41.599009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfeb9d-5c85-45db-b372-30fffaa0e597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:41.599353 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bf9f4-6374-48d9-9a50-88871fbea369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:41.599980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf9f4-6374-48d9-9a50-88871fbea369 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:41.600259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf9f4-6374-48d9-9a50-88871fbea369 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:41.600535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf9f4-6374-48d9-9a50-88871fbea369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:41.601388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfeb9d-5c85-45db-b372-30fffaa0e597 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:41.611406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 185/370] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:41.612622 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfeb9d-5c85-45db-b372-30fffaa0e597 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:41.676298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:41.678358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bf9f4-6374-48d9-9a50-88871fbea369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:41.680142 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bf9f4-6374-48d9-9a50-88871fbea369 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:41.727050 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:41.737174 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfeb9d-5c85-45db-b372-30fffaa0e597 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:41.773472 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f675c9-e977-48bd-bf76-0fa663461102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:41.774442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f675c9-e977-48bd-bf76-0fa663461102 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:41.774920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f675c9-e977-48bd-bf76-0fa663461102 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:41.775388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f675c9-e977-48bd-bf76-0fa663461102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:41.776371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f675c9-e977-48bd-bf76-0fa663461102 None admin] RBAC: Adding query filter params (group.id=6ba1f72a208d4d44b16d7c41991f009f, role.id=a21446fa03b24a5ebbaf61a4827146e7, scope.project.id=4fd381b007244ca79e5e671f37551f9a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:41.776970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f675c9-e977-48bd-bf76-0fa663461102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:41.779572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f675c9-e977-48bd-bf76-0fa663461102 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:41.786710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 186/371] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 05:19:41 2022] GET /identity/v3/role_assignments?group.id=6ba1f72a208d4d44b16d7c41991f009f&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:41.787741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f675c9-e977-48bd-bf76-0fa663461102 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:41.798847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 186/372] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:41.802281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bf9f4-6374-48d9-9a50-88871fbea369 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:41.923116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f675c9-e977-48bd-bf76-0fa663461102 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:41.938731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:41.962927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d68f7-894d-475a-b28b-ac36e075b9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:41.963910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d68f7-894d-475a-b28b-ac36e075b9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:41.964412 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d68f7-894d-475a-b28b-ac36e075b9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:41.965531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d68f7-894d-475a-b28b-ac36e075b9c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:41.966660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d68f7-894d-475a-b28b-ac36e075b9c7 None admin] RBAC: Adding query filter params (role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6, user.id=f15a6d2f4eca408895563a7b97b0eb6c, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:41.967176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d68f7-894d-475a-b28b-ac36e075b9c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:41.969265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d68f7-894d-475a-b28b-ac36e075b9c7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:41.975643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bf9f4-6374-48d9-9a50-88871fbea369 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:41.984316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 187/373] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 05:19:41 2022] GET /identity/v3/role_assignments?user.id=f15a6d2f4eca408895563a7b97b0eb6c&scope.system=all&role.id=a1a15b7daf9f4fa697a9d35e7ce7dab6 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:41.985520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d68f7-894d-475a-b28b-ac36e075b9c7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:42.078580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be90d6-a642-4289-a49a-d4482eec65ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:42.079225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be90d6-a642-4289-a49a-d4482eec65ee None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:42.079506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be90d6-a642-4289-a49a-d4482eec65ee None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:42.079776 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be90d6-a642-4289-a49a-d4482eec65ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:42.116323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:42.123189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d68f7-894d-475a-b28b-ac36e075b9c7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:42.189857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51f94c-d1c1-4da1-828c-ffff7a35eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:42.190677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f94c-d1c1-4da1-828c-ffff7a35eaec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:42.190963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f94c-d1c1-4da1-828c-ffff7a35eaec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:42.191357 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51f94c-d1c1-4da1-828c-ffff7a35eaec None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:42.192619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51f94c-d1c1-4da1-828c-ffff7a35eaec None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:42.194123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51f94c-d1c1-4da1-828c-ffff7a35eaec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:42.196006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 188/374] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:41 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:42.201402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51f94c-d1c1-4da1-828c-ffff7a35eaec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:42.217794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be90d6-a642-4289-a49a-d4482eec65ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:42.219285 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be90d6-a642-4289-a49a-d4482eec65ee None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:42.253656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:42.323811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51f94c-d1c1-4da1-828c-ffff7a35eaec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:42.363205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27a81-b8e8-4e2a-9a50-ae8a114505eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:42.363715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27a81-b8e8-4e2a-9a50-ae8a114505eb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:42.363990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27a81-b8e8-4e2a-9a50-ae8a114505eb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:42.364260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27a81-b8e8-4e2a-9a50-ae8a114505eb None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:42.366128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc27a81-b8e8-4e2a-9a50-ae8a114505eb None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:42.366416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 187/375] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:42.367845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc27a81-b8e8-4e2a-9a50-ae8a114505eb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:42.369785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 189/376] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:42 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:42.372806 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be90d6-a642-4289-a49a-d4482eec65ee None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:42.375165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27a81-b8e8-4e2a-9a50-ae8a114505eb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:42.439822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:42.504211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be90d6-a642-4289-a49a-d4482eec65ee None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:42.512567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27a81-b8e8-4e2a-9a50-ae8a114505eb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:42.520333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:42.541579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a20b9-29d2-492e-837e-3630721e1949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:42.542593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a20b9-29d2-492e-837e-3630721e1949 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:42.543127 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a20b9-29d2-492e-837e-3630721e1949 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:42.543598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a20b9-29d2-492e-837e-3630721e1949 None admin] PATH_INFO: `/v3/projects/75ff8d8e50894a1db12ad71f3510dfd6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:42.545151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a20b9-29d2-492e-837e-3630721e1949 None admin] RBAC: Authorizing `identity:get_project(project_id=75ff8d8e50894a1db12ad71f3510dfd6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:42.546911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a20b9-29d2-492e-837e-3630721e1949 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:42.549639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 188/377] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:42 2022] GET /identity/v3/projects/75ff8d8e50894a1db12ad71f3510dfd6 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:42.553192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9734a3-12c0-406e-bd80-0f499eb38b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:42.553192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9734a3-12c0-406e-bd80-0f499eb38b20 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:42.553192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9734a3-12c0-406e-bd80-0f499eb38b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:42.553192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9734a3-12c0-406e-bd80-0f499eb38b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:42.553783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9734a3-12c0-406e-bd80-0f499eb38b20 None admin] RBAC: Adding query filter params (group.id=6ba1f72a208d4d44b16d7c41991f009f, role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7, scope.project.id=4fd381b007244ca79e5e671f37551f9a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:42.553783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9734a3-12c0-406e-bd80-0f499eb38b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:42.554331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9734a3-12c0-406e-bd80-0f499eb38b20 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:42.556440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a20b9-29d2-492e-837e-3630721e1949 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:42.561157 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 190/378] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 05:19:42 2022] GET /identity/v3/role_assignments?group.id=6ba1f72a208d4d44b16d7c41991f009f&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:42.670020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a20b9-29d2-492e-837e-3630721e1949 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:42.689541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:42.708953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e89b14-e0c2-4070-9677-3f7f03a48929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:42.709662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e89b14-e0c2-4070-9677-3f7f03a48929 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:42.709944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e89b14-e0c2-4070-9677-3f7f03a48929 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:42.714162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e89b14-e0c2-4070-9677-3f7f03a48929 None admin] PATH_INFO: `/v3/groups/2660c160f4684879a52b74d3aac26d46` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:42.718167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e89b14-e0c2-4070-9677-3f7f03a48929 None admin] RBAC: Authorizing `identity:get_group(group_id=2660c160f4684879a52b74d3aac26d46)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:42.719655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e89b14-e0c2-4070-9677-3f7f03a48929 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:42.721910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 189/379] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:42 2022] GET /identity/v3/groups/2660c160f4684879a52b74d3aac26d46 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:42.728128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9734a3-12c0-406e-bd80-0f499eb38b20 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:42.794355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b3dc-f0a1-4341-930c-1bc4cf9874cb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:42.794689 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b3dc-f0a1-4341-930c-1bc4cf9874cb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:42.794909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b3dc-f0a1-4341-930c-1bc4cf9874cb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:42.796419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 190/380] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:42.801498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fe01a-0b83-422c-8340-3fc448a61b48 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:42.801780 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fe01a-0b83-422c-8340-3fc448a61b48 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:42.802073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fe01a-0b83-422c-8340-3fc448a61b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:42.824736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ac9fe01a-0b83-422c-8340-3fc448a61b48 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:42.825963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ac9fe01a-0b83-422c-8340-3fc448a61b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:42.887948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9734a3-12c0-406e-bd80-0f499eb38b20 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:42.895830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 191/381] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:42.919454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fe01a-0b83-422c-8340-3fc448a61b48 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:42.965192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da35fe-608e-4738-a9ed-4fed1d488d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:42.966151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da35fe-608e-4738-a9ed-4fed1d488d42 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:42.966660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da35fe-608e-4738-a9ed-4fed1d488d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:42.967148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da35fe-608e-4738-a9ed-4fed1d488d42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:42.968290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da35fe-608e-4738-a9ed-4fed1d488d42 None admin] RBAC: Adding query filter params (group.id=2660c160f4684879a52b74d3aac26d46, role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=75ff8d8e50894a1db12ad71f3510dfd6) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:42.968867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da35fe-608e-4738-a9ed-4fed1d488d42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:42.970568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da35fe-608e-4738-a9ed-4fed1d488d42 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:42.983911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 191/382] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 05:19:42 2022] GET /identity/v3/role_assignments?group.id=2660c160f4684879a52b74d3aac26d46&scope.project.id=75ff8d8e50894a1db12ad71f3510dfd6&role.id=57a86ff4c9de433399662eebf6893065 => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:43.071510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fe01a-0b83-422c-8340-3fc448a61b48 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:43.085975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:43.119755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d18c6-9285-4feb-9aea-a9f377730cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:43.120407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d18c6-9285-4feb-9aea-a9f377730cae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:43.120685 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d18c6-9285-4feb-9aea-a9f377730cae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:43.121663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d18c6-9285-4feb-9aea-a9f377730cae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:43.137474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d18c6-9285-4feb-9aea-a9f377730cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1b4d18c6-9285-4feb-9aea-a9f377730cae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:43.142891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:43.143803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:43.145009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 192/383] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:43.150098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da35fe-608e-4738-a9ed-4fed1d488d42 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:43.213506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:43.300258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da35fe-608e-4738-a9ed-4fed1d488d42 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:43.343127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2a367-6869-45bd-8c69-e292443ccf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:43.343753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2a367-6869-45bd-8c69-e292443ccf16 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:43.344028 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2a367-6869-45bd-8c69-e292443ccf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:43.344296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2a367-6869-45bd-8c69-e292443ccf16 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:43.345015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2a367-6869-45bd-8c69-e292443ccf16 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:43.345339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2a367-6869-45bd-8c69-e292443ccf16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:43.346713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2a367-6869-45bd-8c69-e292443ccf16 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:43.360445 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 192/384] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:43.361739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d18c6-9285-4feb-9aea-a9f377730cae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:43.510756 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d18c6-9285-4feb-9aea-a9f377730cae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:43.551456 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd697c6-e2fc-405f-b1ed-7aa70a4675d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:43.552042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd697c6-e2fc-405f-b1ed-7aa70a4675d6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:43.552321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd697c6-e2fc-405f-b1ed-7aa70a4675d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:43.552597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd697c6-e2fc-405f-b1ed-7aa70a4675d6 None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:43.554050 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd697c6-e2fc-405f-b1ed-7aa70a4675d6 None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:43.555501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd697c6-e2fc-405f-b1ed-7aa70a4675d6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:43.557390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 193/385] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:43 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:43.563171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2a367-6869-45bd-8c69-e292443ccf16 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:43.684549 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:43.690716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2a367-6869-45bd-8c69-e292443ccf16 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:43.737103 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e351c0-4b2e-4043-abaa-a29495b6a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:43.737779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e351c0-4b2e-4043-abaa-a29495b6a38a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:43.738056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e351c0-4b2e-4043-abaa-a29495b6a38a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:43.738325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e351c0-4b2e-4043-abaa-a29495b6a38a None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:43.739507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e351c0-4b2e-4043-abaa-a29495b6a38a None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:43.740948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e351c0-4b2e-4043-abaa-a29495b6a38a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:43.744279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 193/386] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:43 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:43.748838 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd697c6-e2fc-405f-b1ed-7aa70a4675d6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:43.804582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:43.889820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd697c6-e2fc-405f-b1ed-7aa70a4675d6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:43.935805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1cbc-6cad-44b1-89eb-31398c532765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:43.936488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1cbc-6cad-44b1-89eb-31398c532765 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:43.936762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1cbc-6cad-44b1-89eb-31398c532765 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:43.937020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1cbc-6cad-44b1-89eb-31398c532765 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87/groups/6ba1f72a208d4d44b16d7c41991f009f/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:43.938998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1cbc-6cad-44b1-89eb-31398c532765 None admin] RBAC: Authorizing `identity:create_grant(project_id=86802e43046f4a66bdee6d53a4239a87, group_id=6ba1f72a208d4d44b16d7c41991f009f, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:43.940424 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1cbc-6cad-44b1-89eb-31398c532765 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:43.961794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6c1c8-d31c-4b40-93ca-d350650d067a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:43.962094 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6c1c8-d31c-4b40-93ca-d350650d067a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:43.962351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6c1c8-d31c-4b40-93ca-d350650d067a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:43.963960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 194/387] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:43.969416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e102-8365-4492-9c95-c88118789a0c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:43.969696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e102-8365-4492-9c95-c88118789a0c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:43.970642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734e102-8365-4492-9c95-c88118789a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:43.988914 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4734e102-8365-4492-9c95-c88118789a0c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:43.990306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4734e102-8365-4492-9c95-c88118789a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:44.035465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 194/388] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 05:19:43 2022] PUT /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87/groups/6ba1f72a208d4d44b16d7c41991f009f/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:44.065516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 195/389] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:44.088690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1cbc-6cad-44b1-89eb-31398c532765 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:44.201575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:44.208901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1cbc-6cad-44b1-89eb-31398c532765 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:44.245090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300320d-27ea-4dbd-9d0e-6a08af31266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:44.245861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300320d-27ea-4dbd-9d0e-6a08af31266b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:44.246326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300320d-27ea-4dbd-9d0e-6a08af31266b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:44.246608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300320d-27ea-4dbd-9d0e-6a08af31266b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:44.258368 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300320d-27ea-4dbd-9d0e-6a08af31266b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d300320d-27ea-4dbd-9d0e-6a08af31266b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:44.263556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:44.264598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:44.265430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 195/390] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:44.271012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734e102-8365-4492-9c95-c88118789a0c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:44.377634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:44.383274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734e102-8365-4492-9c95-c88118789a0c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:44.419164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e3031-cf69-4e12-a988-72f48adc9a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:44.419798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e3031-cf69-4e12-a988-72f48adc9a80 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:44.420078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e3031-cf69-4e12-a988-72f48adc9a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:44.420354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e3031-cf69-4e12-a988-72f48adc9a80 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:44.421077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e3031-cf69-4e12-a988-72f48adc9a80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:44.421434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e3031-cf69-4e12-a988-72f48adc9a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:44.422866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e3031-cf69-4e12-a988-72f48adc9a80 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:44.432066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 196/391] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:44.438381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300320d-27ea-4dbd-9d0e-6a08af31266b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:44.479677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99343e89-2e56-4576-a6fb-a16e1689cb61 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:44.482734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99343e89-2e56-4576-a6fb-a16e1689cb61 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:44.482734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99343e89-2e56-4576-a6fb-a16e1689cb61 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:44.482734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 197/392] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:44.492396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3048-c200-493c-a661-fd59cc271ccb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:44.492396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3048-c200-493c-a661-fd59cc271ccb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:44.492396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3048-c200-493c-a661-fd59cc271ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:44.521902 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d3ba3048-c200-493c-a661-fd59cc271ccb None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:44.524453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d3ba3048-c200-493c-a661-fd59cc271ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:44.612318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300320d-27ea-4dbd-9d0e-6a08af31266b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:44.654112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 198/393] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:44.675504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69163292-91b9-4c15-bf26-8529a0a7bc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:44.676404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69163292-91b9-4c15-bf26-8529a0a7bc8a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:44.676833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69163292-91b9-4c15-bf26-8529a0a7bc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:44.677282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69163292-91b9-4c15-bf26-8529a0a7bc8a None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:44.679980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69163292-91b9-4c15-bf26-8529a0a7bc8a None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:44.681593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69163292-91b9-4c15-bf26-8529a0a7bc8a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:44.684347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 196/394] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:44 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:44.689008 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba3048-c200-493c-a661-fd59cc271ccb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:44.735721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69163292-91b9-4c15-bf26-8529a0a7bc8a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:44.764441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:44.849573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69163292-91b9-4c15-bf26-8529a0a7bc8a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:44.862987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:44.888795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a2c6d-c597-4d1c-ab31-88b0635d2755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:44.889919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2c6d-c597-4d1c-ab31-88b0635d2755 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:44.890352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2c6d-c597-4d1c-ab31-88b0635d2755 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:44.890812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2c6d-c597-4d1c-ab31-88b0635d2755 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:44.891094 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba3048-c200-493c-a661-fd59cc271ccb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:44.903672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a2c6d-c597-4d1c-ab31-88b0635d2755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e40a2c6d-c597-4d1c-ab31-88b0635d2755 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:44.909148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:44.910269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:44.911442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:44.914109 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 197/395] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:44.925179 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a2c6d-c597-4d1c-ab31-88b0635d2755 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:44.949669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b552dc-4498-41f6-8a7f-7fdc0d97cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:44.950320 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b552dc-4498-41f6-8a7f-7fdc0d97cddd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:44.950600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b552dc-4498-41f6-8a7f-7fdc0d97cddd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:44.950871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b552dc-4498-41f6-8a7f-7fdc0d97cddd None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:44.953112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b552dc-4498-41f6-8a7f-7fdc0d97cddd None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:44.955124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b552dc-4498-41f6-8a7f-7fdc0d97cddd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:44.957280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 199/396] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:44 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:44.962823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b552dc-4498-41f6-8a7f-7fdc0d97cddd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:45.081516 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:45.117520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a2c6d-c597-4d1c-ab31-88b0635d2755 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:45.153459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd0ed9-0ed6-45ee-a3f9-7f523b34ef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:45.154098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd0ed9-0ed6-45ee-a3f9-7f523b34ef12 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:45.154353 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd0ed9-0ed6-45ee-a3f9-7f523b34ef12 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:45.154623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd0ed9-0ed6-45ee-a3f9-7f523b34ef12 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:45.155340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd0ed9-0ed6-45ee-a3f9-7f523b34ef12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:45.157571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd0ed9-0ed6-45ee-a3f9-7f523b34ef12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:45.157571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd0ed9-0ed6-45ee-a3f9-7f523b34ef12 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:45.166012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 198/397] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:45.172143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd0ed9-0ed6-45ee-a3f9-7f523b34ef12 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:45.174685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b552dc-4498-41f6-8a7f-7fdc0d97cddd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:45.246983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc95213-e1cb-4e30-a93a-74c431ef5769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:45.247840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95213-e1cb-4e30-a93a-74c431ef5769 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:45.248222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95213-e1cb-4e30-a93a-74c431ef5769 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:45.248607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95213-e1cb-4e30-a93a-74c431ef5769 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87/groups/6ba1f72a208d4d44b16d7c41991f009f/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:45.251188 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc95213-e1cb-4e30-a93a-74c431ef5769 None admin] RBAC: Authorizing `identity:create_grant(project_id=86802e43046f4a66bdee6d53a4239a87, group_id=6ba1f72a208d4d44b16d7c41991f009f, role_id=e24e5dc3a48b4cfdac7a99de5f2f78a7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:45.252873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc95213-e1cb-4e30-a93a-74c431ef5769 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:45.274641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd0ed9-0ed6-45ee-a3f9-7f523b34ef12 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:45.309765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed6c19-960a-4fac-9efc-9a12f6230b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:45.313395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6c19-960a-4fac-9efc-9a12f6230b95 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:45.313395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6c19-960a-4fac-9efc-9a12f6230b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:45.313395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6c19-960a-4fac-9efc-9a12f6230b95 None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:45.313395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed6c19-960a-4fac-9efc-9a12f6230b95 None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:45.314334 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed6c19-960a-4fac-9efc-9a12f6230b95 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:45.316421 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 199/398] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:45 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:45.325161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed6c19-960a-4fac-9efc-9a12f6230b95 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:45.349513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:45.369463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 200/399] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 05:19:44 2022] PUT /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87/groups/6ba1f72a208d4d44b16d7c41991f009f/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:45.502442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed6c19-960a-4fac-9efc-9a12f6230b95 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:45.540032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf046d2f-a0a3-481d-baf9-c4d9837d334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:45.540688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf046d2f-a0a3-481d-baf9-c4d9837d334b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:45.540967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf046d2f-a0a3-481d-baf9-c4d9837d334b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:45.541265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf046d2f-a0a3-481d-baf9-c4d9837d334b None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:45.542442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf046d2f-a0a3-481d-baf9-c4d9837d334b None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:45.544427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf046d2f-a0a3-481d-baf9-c4d9837d334b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:45.546481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 200/400] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:45 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:45.552294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc95213-e1cb-4e30-a93a-74c431ef5769 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:45.570866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8e613-40d8-4baf-b953-2e3c2d617fc1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:45.571194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8e613-40d8-4baf-b953-2e3c2d617fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:45.571418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8e613-40d8-4baf-b953-2e3c2d617fc1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:45.573017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:45.574305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 201/401] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:45.585845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b20c8-9695-42c8-992e-474d85864e17 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:45.586129 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b20c8-9695-42c8-992e-474d85864e17 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:45.586746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b20c8-9695-42c8-992e-474d85864e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:45.609906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-193b20c8-9695-42c8-992e-474d85864e17 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:45.611455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-193b20c8-9695-42c8-992e-474d85864e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:45.685346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc95213-e1cb-4e30-a93a-74c431ef5769 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:45.689957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 202/402] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:45.691735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78962943-7a3e-4a8d-a1de-3b868fbd4137 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:45.692241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78962943-7a3e-4a8d-a1de-3b868fbd4137 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:45.692713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78962943-7a3e-4a8d-a1de-3b868fbd4137 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:45.694914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 203/403] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:45.700242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8df02d-ec29-4a3a-b7ab-1e0d83e902af None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:45.700518 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8df02d-ec29-4a3a-b7ab-1e0d83e902af None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:45.700784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8df02d-ec29-4a3a-b7ab-1e0d83e902af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:45.719435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3d8df02d-ec29-4a3a-b7ab-1e0d83e902af None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:45.720547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3d8df02d-ec29-4a3a-b7ab-1e0d83e902af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:45.725444 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:45.729175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad7823-f323-4cf2-aba2-642dbbb3e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:45.730671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7823-f323-4cf2-aba2-642dbbb3e9a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:45.731170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7823-f323-4cf2-aba2-642dbbb3e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:45.732018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad7823-f323-4cf2-aba2-642dbbb3e9a2 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a/groups/6ba1f72a208d4d44b16d7c41991f009f/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:45.737308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad7823-f323-4cf2-aba2-642dbbb3e9a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fd381b007244ca79e5e671f37551f9a, group_id=6ba1f72a208d4d44b16d7c41991f009f, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:45.738764 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad7823-f323-4cf2-aba2-642dbbb3e9a2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:45.792571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 204/404] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:45.801816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8df02d-ec29-4a3a-b7ab-1e0d83e902af None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:45.860321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 201/405] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 05:19:45 2022] PUT /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a/groups/6ba1f72a208d4d44b16d7c41991f009f/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:45.865343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad7823-f323-4cf2-aba2-642dbbb3e9a2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:45.968432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8df02d-ec29-4a3a-b7ab-1e0d83e902af None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:46.005144 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:46.037234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad7823-f323-4cf2-aba2-642dbbb3e9a2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:46.055067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c9cc3-a3f7-4574-b8da-29ad84a6a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:46.056748 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c9cc3-a3f7-4574-b8da-29ad84a6a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:46.056748 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c9cc3-a3f7-4574-b8da-29ad84a6a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:46.056748 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c9cc3-a3f7-4574-b8da-29ad84a6a8d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:46.068036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:46.072082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c9cc3-a3f7-4574-b8da-29ad84a6a8d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:46.077945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0a41d-6a25-4ff5-bc64-8fee10c452b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:46.078600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0a41d-6a25-4ff5-bc64-8fee10c452b3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:46.078882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0a41d-6a25-4ff5-bc64-8fee10c452b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:46.079158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0a41d-6a25-4ff5-bc64-8fee10c452b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8a3c9cc3-a3f7-4574-b8da-29ad84a6a8d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:46.080028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:46.080912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:46.083250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 205/406] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:19:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:46.091817 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c9cc3-a3f7-4574-b8da-29ad84a6a8d4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:46.096084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0a41d-6a25-4ff5-bc64-8fee10c452b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d2c0a41d-6a25-4ff5-bc64-8fee10c452b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:46.102023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:46.103011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:46.103828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 202/407] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:46.111696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0a41d-6a25-4ff5-bc64-8fee10c452b3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:46.244839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c9cc3-a3f7-4574-b8da-29ad84a6a8d4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:46.280603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0a41d-6a25-4ff5-bc64-8fee10c452b3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:46.291119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53389-b472-4654-9f8a-28db2a4daf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:46.295069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53389-b472-4654-9f8a-28db2a4daf0a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:46.295593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53389-b472-4654-9f8a-28db2a4daf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:46.296078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53389-b472-4654-9f8a-28db2a4daf0a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:46.297075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d53389-b472-4654-9f8a-28db2a4daf0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:46.297643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d53389-b472-4654-9f8a-28db2a4daf0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:46.299243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d53389-b472-4654-9f8a-28db2a4daf0a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:46.319129 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 206/408] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:46.325476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53389-b472-4654-9f8a-28db2a4daf0a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:46.359694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcda971-e062-4b21-a890-80e686835ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:46.360736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcda971-e062-4b21-a890-80e686835ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:46.361462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcda971-e062-4b21-a890-80e686835ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:46.362724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcda971-e062-4b21-a890-80e686835ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:46.363669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcda971-e062-4b21-a890-80e686835ab7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:46.364589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcda971-e062-4b21-a890-80e686835ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:46.367610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcda971-e062-4b21-a890-80e686835ab7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:46.371007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:46.389438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 203/409] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:46.394261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcda971-e062-4b21-a890-80e686835ab7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:46.449564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:46.499650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53389-b472-4654-9f8a-28db2a4daf0a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:46.535973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4215a-40b9-4dbe-b178-73049fb0c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:46.536698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4215a-40b9-4dbe-b178-73049fb0c83e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:46.536895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4215a-40b9-4dbe-b178-73049fb0c83e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:46.537199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4215a-40b9-4dbe-b178-73049fb0c83e None admin] PATH_INFO: `/v3/groups/2660c160f4684879a52b74d3aac26d46` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:46.538397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4215a-40b9-4dbe-b178-73049fb0c83e None admin] RBAC: Authorizing `identity:get_group(group_id=2660c160f4684879a52b74d3aac26d46)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:46.539872 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4215a-40b9-4dbe-b178-73049fb0c83e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:46.541519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcda971-e062-4b21-a890-80e686835ab7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:46.547109 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 207/410] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:46 2022] GET /identity/v3/groups/2660c160f4684879a52b74d3aac26d46 => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:46.548401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834487b-2732-4e19-8c12-e0e1b8a0883b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:46.548690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834487b-2732-4e19-8c12-e0e1b8a0883b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:46.548967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834487b-2732-4e19-8c12-e0e1b8a0883b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:46.550541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 208/411] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:46.551576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834487b-2732-4e19-8c12-e0e1b8a0883b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:46.588366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f335249-f323-48bc-b68a-d7c86800a928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:46.591075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f335249-f323-48bc-b68a-d7c86800a928 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:46.591526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f335249-f323-48bc-b68a-d7c86800a928 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:46.591960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f335249-f323-48bc-b68a-d7c86800a928 None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:46.593311 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f335249-f323-48bc-b68a-d7c86800a928 None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:46.594901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f335249-f323-48bc-b68a-d7c86800a928 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:46.597512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 204/412] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:46 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:46.602673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dea38d-7fa5-483c-bcb5-d6dd2af376ad None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:46.602959 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dea38d-7fa5-483c-bcb5-d6dd2af376ad None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:46.603232 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dea38d-7fa5-483c-bcb5-d6dd2af376ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:46.622718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-56dea38d-7fa5-483c-bcb5-d6dd2af376ad None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:46.623911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-56dea38d-7fa5-483c-bcb5-d6dd2af376ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:46.685684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834487b-2732-4e19-8c12-e0e1b8a0883b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:46.689177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:46.700196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 205/413] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:46.700530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dea38d-7fa5-483c-bcb5-d6dd2af376ad None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:46.728377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:46.739844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea007bfa-16e2-4c9d-9bed-d237979dea68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:46.740501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007bfa-16e2-4c9d-9bed-d237979dea68 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:46.740780 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007bfa-16e2-4c9d-9bed-d237979dea68 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:46.741051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007bfa-16e2-4c9d-9bed-d237979dea68 None admin] PATH_INFO: `/v3/projects/75ff8d8e50894a1db12ad71f3510dfd6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:46.743500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea007bfa-16e2-4c9d-9bed-d237979dea68 None admin] RBAC: Authorizing `identity:get_project(project_id=75ff8d8e50894a1db12ad71f3510dfd6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:46.744998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea007bfa-16e2-4c9d-9bed-d237979dea68 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:46.748437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 209/414] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:46 2022] GET /identity/v3/projects/75ff8d8e50894a1db12ad71f3510dfd6 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:46.749552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea007bfa-16e2-4c9d-9bed-d237979dea68 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:46.828303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dea38d-7fa5-483c-bcb5-d6dd2af376ad None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:46.872866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3889b-1c4b-4fd0-ab7f-04fc79d583e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:46.874011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3889b-1c4b-4fd0-ab7f-04fc79d583e0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:46.874453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3889b-1c4b-4fd0-ab7f-04fc79d583e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:46.875225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3889b-1c4b-4fd0-ab7f-04fc79d583e0 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:46.877267 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3889b-1c4b-4fd0-ab7f-04fc79d583e0 None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:46.878696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea007bfa-16e2-4c9d-9bed-d237979dea68 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:46.879030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3889b-1c4b-4fd0-ab7f-04fc79d583e0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:46.887233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 206/415] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:46 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:46.888223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3889b-1c4b-4fd0-ab7f-04fc79d583e0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:46.915305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b38b91-8f65-4c5d-aa0d-58f619d0a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:46.916109 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b38b91-8f65-4c5d-aa0d-58f619d0a611 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:46.916494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b38b91-8f65-4c5d-aa0d-58f619d0a611 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:46.916870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b38b91-8f65-4c5d-aa0d-58f619d0a611 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:46.942829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b38b91-8f65-4c5d-aa0d-58f619d0a611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-64b38b91-8f65-4c5d-aa0d-58f619d0a611 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:46.948002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:46.949879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:46.950908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:46.952651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 210/416] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:46.953512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b38b91-8f65-4c5d-aa0d-58f619d0a611 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:46.973105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:47.014544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3889b-1c4b-4fd0-ab7f-04fc79d583e0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:47.017446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:47.051548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe9f4d-50ca-4fd7-9e0e-7cd86431f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:47.052223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe9f4d-50ca-4fd7-9e0e-7cd86431f38d None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:47.052502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe9f4d-50ca-4fd7-9e0e-7cd86431f38d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:47.052856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe9f4d-50ca-4fd7-9e0e-7cd86431f38d None admin] PATH_INFO: `/v3/projects/75ff8d8e50894a1db12ad71f3510dfd6/groups/2660c160f4684879a52b74d3aac26d46/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:47.055080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe9f4d-50ca-4fd7-9e0e-7cd86431f38d None admin] RBAC: Authorizing `identity:create_grant(project_id=75ff8d8e50894a1db12ad71f3510dfd6, group_id=2660c160f4684879a52b74d3aac26d46, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:47.056521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe9f4d-50ca-4fd7-9e0e-7cd86431f38d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:47.064052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b38b91-8f65-4c5d-aa0d-58f619d0a611 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:47.100260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf0327-b48c-4557-9c60-101ba8f67707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:47.101337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf0327-b48c-4557-9c60-101ba8f67707 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:47.101879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf0327-b48c-4557-9c60-101ba8f67707 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:47.102372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf0327-b48c-4557-9c60-101ba8f67707 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a/groups/6ba1f72a208d4d44b16d7c41991f009f/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:47.104837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf0327-b48c-4557-9c60-101ba8f67707 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fd381b007244ca79e5e671f37551f9a, group_id=6ba1f72a208d4d44b16d7c41991f009f, role_id=e24e5dc3a48b4cfdac7a99de5f2f78a7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:47.106622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf0327-b48c-4557-9c60-101ba8f67707 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:47.121283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 207/417] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 05:19:46 2022] PUT /identity/v3/projects/75ff8d8e50894a1db12ad71f3510dfd6/groups/2660c160f4684879a52b74d3aac26d46/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:47.121283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe9f4d-50ca-4fd7-9e0e-7cd86431f38d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:47.187039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 211/418] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 05:19:46 2022] PUT /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a/groups/6ba1f72a208d4d44b16d7c41991f009f/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:19:47.259209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe9f4d-50ca-4fd7-9e0e-7cd86431f38d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:47.287164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:47.302654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47548bae-e5e6-4947-b063-96e79ca11ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:47.303958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548bae-e5e6-4947-b063-96e79ca11ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:47.304455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548bae-e5e6-4947-b063-96e79ca11ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:47.304986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548bae-e5e6-4947-b063-96e79ca11ec5 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:47.306013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47548bae-e5e6-4947-b063-96e79ca11ec5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:47.306518 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47548bae-e5e6-4947-b063-96e79ca11ec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:47.308714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47548bae-e5e6-4947-b063-96e79ca11ec5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:47.323493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 208/419] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:47.329530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf0327-b48c-4557-9c60-101ba8f67707 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:47.453189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf0327-b48c-4557-9c60-101ba8f67707 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:47.471345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:47.489727 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4f2bc-37fd-416b-b035-2dc65a1ecb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:47.490356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f2bc-37fd-416b-b035-2dc65a1ecb12 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:47.490642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f2bc-37fd-416b-b035-2dc65a1ecb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:47.490920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f2bc-37fd-416b-b035-2dc65a1ecb12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:47.566379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4f2bc-37fd-416b-b035-2dc65a1ecb12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:47.567905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4f2bc-37fd-416b-b035-2dc65a1ecb12 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:47.702080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604646b9-4a5b-469f-b57f-37c2b74f9444 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:47.703031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604646b9-4a5b-469f-b57f-37c2b74f9444 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:47.703593 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604646b9-4a5b-469f-b57f-37c2b74f9444 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:47.705435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 209/420] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:47.709624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 212/421] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:47.710514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c30d5-a64b-4d90-8ed7-98ebb803b976 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:47.711012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c30d5-a64b-4d90-8ed7-98ebb803b976 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:47.711483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c30d5-a64b-4d90-8ed7-98ebb803b976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:47.717170 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4f2bc-37fd-416b-b035-2dc65a1ecb12 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:47.745628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:47.758194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fd7c30d5-a64b-4d90-8ed7-98ebb803b976 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:47.759652 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fd7c30d5-a64b-4d90-8ed7-98ebb803b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:47.829306 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4f2bc-37fd-416b-b035-2dc65a1ecb12 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:47.870016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a1c97-181d-46c3-9c2e-f7baa673c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:47.871315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a1c97-181d-46c3-9c2e-f7baa673c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:47.871606 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a1c97-181d-46c3-9c2e-f7baa673c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:47.871874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a1c97-181d-46c3-9c2e-f7baa673c9b7 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:47.873553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a1c97-181d-46c3-9c2e-f7baa673c9b7 None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:47.875336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a1c97-181d-46c3-9c2e-f7baa673c9b7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:47.877345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 213/422] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:47 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:47.882491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a1c97-181d-46c3-9c2e-f7baa673c9b7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:47.932928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 210/423] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:47.974719 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c30d5-a64b-4d90-8ed7-98ebb803b976 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:47.981827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:47.995470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a1c97-181d-46c3-9c2e-f7baa673c9b7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:48.035647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd086-e33c-4b7c-8d54-c3283b14da81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:48.036347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd086-e33c-4b7c-8d54-c3283b14da81 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:48.036640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd086-e33c-4b7c-8d54-c3283b14da81 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:48.036913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd086-e33c-4b7c-8d54-c3283b14da81 None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:48.038265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cd086-e33c-4b7c-8d54-c3283b14da81 None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:48.039941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cd086-e33c-4b7c-8d54-c3283b14da81 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:48.042311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 214/424] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:47 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:48.062882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd086-e33c-4b7c-8d54-c3283b14da81 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:48.149591 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c30d5-a64b-4d90-8ed7-98ebb803b976 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:48.167570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:48.207965 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98848ccd-94b9-482b-b0a7-a89cf08c643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:48.208667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98848ccd-94b9-482b-b0a7-a89cf08c643c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:48.208953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98848ccd-94b9-482b-b0a7-a89cf08c643c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:48.209283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98848ccd-94b9-482b-b0a7-a89cf08c643c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:48.225801 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98848ccd-94b9-482b-b0a7-a89cf08c643c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-98848ccd-94b9-482b-b0a7-a89cf08c643c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:48.232804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:48.234669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:48.236435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 211/425] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:48.237871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b4b0-aa1e-456c-ae1f-d501af5ecb82 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:48.237871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b4b0-aa1e-456c-ae1f-d501af5ecb82 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:48.237871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b4b0-aa1e-456c-ae1f-d501af5ecb82 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:48.241354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 212/426] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:48.241568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5b4b0-aa1e-456c-ae1f-d501af5ecb82 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:48.271557 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd086-e33c-4b7c-8d54-c3283b14da81 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:48.309274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d17b0-7013-46b3-8ff4-90294c22b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:48.309950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d17b0-7013-46b3-8ff4-90294c22b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:48.310229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d17b0-7013-46b3-8ff4-90294c22b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:48.310541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d17b0-7013-46b3-8ff4-90294c22b8c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:48.311335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d17b0-7013-46b3-8ff4-90294c22b8c4 None admin] RBAC: Adding query filter params (group.id=6ba1f72a208d4d44b16d7c41991f009f, role.id=a21446fa03b24a5ebbaf61a4827146e7, scope.project.id=86802e43046f4a66bdee6d53a4239a87) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:48.311641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d17b0-7013-46b3-8ff4-90294c22b8c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:48.313122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d17b0-7013-46b3-8ff4-90294c22b8c4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:48.319706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 215/427] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 05:19:48 2022] GET /identity/v3/role_assignments?group.id=6ba1f72a208d4d44b16d7c41991f009f&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 611 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:48.320933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8dc5a-7dae-42f8-85c7-cdd489d9bc3c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:48.321257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8dc5a-7dae-42f8-85c7-cdd489d9bc3c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:48.321532 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8dc5a-7dae-42f8-85c7-cdd489d9bc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:48.342812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-77d8dc5a-7dae-42f8-85c7-cdd489d9bc3c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:48.344061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-77d8dc5a-7dae-42f8-85c7-cdd489d9bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:48.370124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:48.387817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5b4b0-aa1e-456c-ae1f-d501af5ecb82 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:48.463618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a354cd-9d02-49c4-99d0-f65a36c58e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:48.464310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a354cd-9d02-49c4-99d0-f65a36c58e04 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:48.464707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a354cd-9d02-49c4-99d0-f65a36c58e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:48.465406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a354cd-9d02-49c4-99d0-f65a36c58e04 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:48.465651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a354cd-9d02-49c4-99d0-f65a36c58e04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:48.465907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a354cd-9d02-49c4-99d0-f65a36c58e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:48.468325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a354cd-9d02-49c4-99d0-f65a36c58e04 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:48.478559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 213/428] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:48.484743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a354cd-9d02-49c4-99d0-f65a36c58e04 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:48.495324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 216/429] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:48.523966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:48.541632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8dc5a-7dae-42f8-85c7-cdd489d9bc3c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:48.617833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a354cd-9d02-49c4-99d0-f65a36c58e04 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:48.655768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b231d2d-68cb-4034-a2b7-ac869d88e17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:48.656392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231d2d-68cb-4034-a2b7-ac869d88e17e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:48.656670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231d2d-68cb-4034-a2b7-ac869d88e17e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:48.656939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b231d2d-68cb-4034-a2b7-ac869d88e17e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:48.685387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8dc5a-7dae-42f8-85c7-cdd489d9bc3c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:48.726404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83941df8-2893-4116-be0e-ca3fecf1c799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:48.727054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83941df8-2893-4116-be0e-ca3fecf1c799 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:48.727333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83941df8-2893-4116-be0e-ca3fecf1c799 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:48.727657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83941df8-2893-4116-be0e-ca3fecf1c799 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:48.741293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83941df8-2893-4116-be0e-ca3fecf1c799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:48.747896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b231d2d-68cb-4034-a2b7-ac869d88e17e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-83941df8-2893-4116-be0e-ca3fecf1c799 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:48.748452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:48.749868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:48.750948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 217/430] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:48.753426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b231d2d-68cb-4034-a2b7-ac869d88e17e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:48.762845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83941df8-2893-4116-be0e-ca3fecf1c799 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:48.773704 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:48.799995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:48.884452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 214/431] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:19:48.890124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83941df8-2893-4116-be0e-ca3fecf1c799 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:48.890955 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b231d2d-68cb-4034-a2b7-ac869d88e17e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:48.926879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80a076-e9ee-43ae-8f3e-5749d2d7f350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:48.927820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80a076-e9ee-43ae-8f3e-5749d2d7f350 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:48.928533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80a076-e9ee-43ae-8f3e-5749d2d7f350 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:48.928985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80a076-e9ee-43ae-8f3e-5749d2d7f350 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:48.929891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80a076-e9ee-43ae-8f3e-5749d2d7f350 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:48.930365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80a076-e9ee-43ae-8f3e-5749d2d7f350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:48.931936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80a076-e9ee-43ae-8f3e-5749d2d7f350 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:48.941611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 218/432] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:19:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:48.947314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80a076-e9ee-43ae-8f3e-5749d2d7f350 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:49.005204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b231d2d-68cb-4034-a2b7-ac869d88e17e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:49.040238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:49.043435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bd2b0-2d7e-4a73-8b94-510b5db5ffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:49.044083 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bd2b0-2d7e-4a73-8b94-510b5db5ffd0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:49.046597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bd2b0-2d7e-4a73-8b94-510b5db5ffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:49.046873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bd2b0-2d7e-4a73-8b94-510b5db5ffd0 None admin] PATH_INFO: `/v3/projects/86802e43046f4a66bdee6d53a4239a87` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:49.048101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bd2b0-2d7e-4a73-8b94-510b5db5ffd0 None admin] RBAC: Authorizing `identity:get_project(project_id=86802e43046f4a66bdee6d53a4239a87)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:49.049588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bd2b0-2d7e-4a73-8b94-510b5db5ffd0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:49.053660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 215/433] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:48 2022] GET /identity/v3/projects/86802e43046f4a66bdee6d53a4239a87 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:49.057057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bd2b0-2d7e-4a73-8b94-510b5db5ffd0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:49.061845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:49.084208 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80a076-e9ee-43ae-8f3e-5749d2d7f350 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:49.125146 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7f2af-6839-4a03-bc00-f4f2e9aa5a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:49.125994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7f2af-6839-4a03-bc00-f4f2e9aa5a06 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:49.126328 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7f2af-6839-4a03-bc00-f4f2e9aa5a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:49.126606 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7f2af-6839-4a03-bc00-f4f2e9aa5a06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:49.206852 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bd2b0-2d7e-4a73-8b94-510b5db5ffd0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:49.230441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7f2af-6839-4a03-bc00-f4f2e9aa5a06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:49.231916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7f2af-6839-4a03-bc00-f4f2e9aa5a06 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:49.256550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719fc70-3635-4558-8798-d1b0f4e2c5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:49.257557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719fc70-3635-4558-8798-d1b0f4e2c5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:49.258029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719fc70-3635-4558-8798-d1b0f4e2c5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:49.258509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719fc70-3635-4558-8798-d1b0f4e2c5b4 None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:49.259931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719fc70-3635-4558-8798-d1b0f4e2c5b4 None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:49.262693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719fc70-3635-4558-8798-d1b0f4e2c5b4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:49.264962 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 216/434] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:49 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:49.270842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719fc70-3635-4558-8798-d1b0f4e2c5b4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:49.317735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:49.352384 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 219/435] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:49.360797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7f2af-6839-4a03-bc00-f4f2e9aa5a06 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:49.363127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:49.404399 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719fc70-3635-4558-8798-d1b0f4e2c5b4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:49.454167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5d925-dbf1-4191-bace-5158251c78c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:49.454796 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5d925-dbf1-4191-bace-5158251c78c5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:49.455072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5d925-dbf1-4191-bace-5158251c78c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:49.455340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5d925-dbf1-4191-bace-5158251c78c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:49.456135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5d925-dbf1-4191-bace-5158251c78c5 None admin] RBAC: Adding query filter params (group.id=6ba1f72a208d4d44b16d7c41991f009f, role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7, scope.project.id=86802e43046f4a66bdee6d53a4239a87) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:49.456440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5d925-dbf1-4191-bace-5158251c78c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:49.457931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5d925-dbf1-4191-bace-5158251c78c5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:49.464760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 217/436] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 05:19:49 2022] GET /identity/v3/role_assignments?group.id=6ba1f72a208d4d44b16d7c41991f009f&scope.project.id=86802e43046f4a66bdee6d53a4239a87&role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:49.493667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7f2af-6839-4a03-bc00-f4f2e9aa5a06 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:49.535940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe97982-b120-4e4a-93c0-48170359619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:49.536999 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe97982-b120-4e4a-93c0-48170359619e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:49.537536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe97982-b120-4e4a-93c0-48170359619e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:49.538010 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe97982-b120-4e4a-93c0-48170359619e None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:49.539500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe97982-b120-4e4a-93c0-48170359619e None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:49.541188 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe97982-b120-4e4a-93c0-48170359619e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:49.543512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 220/437] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:49 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:49.549580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5d925-dbf1-4191-bace-5158251c78c5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:49.613792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0121a-6837-48a3-b650-a580066306cc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:49.614100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0121a-6837-48a3-b650-a580066306cc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:49.614338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0121a-6837-48a3-b650-a580066306cc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:49.616917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 221/438] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:49.621609 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610feb-b038-43e7-baf8-345b79e815ae None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:49.621991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610feb-b038-43e7-baf8-345b79e815ae None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:49.622162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610feb-b038-43e7-baf8-345b79e815ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:49.649502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-60610feb-b038-43e7-baf8-345b79e815ae None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:49.651046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60610feb-b038-43e7-baf8-345b79e815ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:49.670621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5d925-dbf1-4191-bace-5158251c78c5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:49.690057 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:49.708215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3280e-058a-40e5-be10-3acbfb74ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:49.708895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3280e-058a-40e5-be10-3acbfb74ede0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:49.709465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3280e-058a-40e5-be10-3acbfb74ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:49.709663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3280e-058a-40e5-be10-3acbfb74ede0 None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:49.711325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3280e-058a-40e5-be10-3acbfb74ede0 None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:49.712575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3280e-058a-40e5-be10-3acbfb74ede0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:49.714677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 218/439] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:49 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:49.721106 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3280e-058a-40e5-be10-3acbfb74ede0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:49.726279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:49.741869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 222/440] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:49.752302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce4d0-87e4-4c0e-98be-9f090162c05e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:49.753001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce4d0-87e4-4c0e-98be-9f090162c05e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:49.753001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce4d0-87e4-4c0e-98be-9f090162c05e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:49.754380 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 223/441] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:49.762977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573f91-f273-4104-a73a-087354facd93 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:49.762977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573f91-f273-4104-a73a-087354facd93 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:49.762977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19573f91-f273-4104-a73a-087354facd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:49.779827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-19573f91-f273-4104-a73a-087354facd93 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:49.781090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-19573f91-f273-4104-a73a-087354facd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:49.837325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3280e-058a-40e5-be10-3acbfb74ede0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:49.856435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 224/442] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:49.857343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19573f91-f273-4104-a73a-087354facd93 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:49.895343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb1692-784a-41b5-a2f6-2fcf077f3c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:49.895968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1692-784a-41b5-a2f6-2fcf077f3c22 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:49.896251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1692-784a-41b5-a2f6-2fcf077f3c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:49.896521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1692-784a-41b5-a2f6-2fcf077f3c22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:49.897432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb1692-784a-41b5-a2f6-2fcf077f3c22 None admin] RBAC: Adding query filter params (group.id=6ba1f72a208d4d44b16d7c41991f009f, role.id=a21446fa03b24a5ebbaf61a4827146e7, scope.project.id=4fd381b007244ca79e5e671f37551f9a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:49.897770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb1692-784a-41b5-a2f6-2fcf077f3c22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:49.899211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb1692-784a-41b5-a2f6-2fcf077f3c22 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:49.905014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 219/443] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 05:19:49 2022] GET /identity/v3/role_assignments?group.id=6ba1f72a208d4d44b16d7c41991f009f&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=a21446fa03b24a5ebbaf61a4827146e7 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:49.905830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb1692-784a-41b5-a2f6-2fcf077f3c22 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:49.964036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:49.967927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19573f91-f273-4104-a73a-087354facd93 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:49.993093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:50.007244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d2378-542c-46b3-8323-97d1e7fd1e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:50.007906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2378-542c-46b3-8323-97d1e7fd1e91 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:50.008187 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2378-542c-46b3-8323-97d1e7fd1e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:50.008461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2378-542c-46b3-8323-97d1e7fd1e91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:50.021660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d2378-542c-46b3-8323-97d1e7fd1e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ca8d2378-542c-46b3-8323-97d1e7fd1e91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:50.026868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:50.028335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:50.029661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 225/444] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:19:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:50.033715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb1692-784a-41b5-a2f6-2fcf077f3c22 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:50.034159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d2378-542c-46b3-8323-97d1e7fd1e91 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:50.076187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb8fe7-bfa2-42aa-abb3-389a35368d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:50.076834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8fe7-bfa2-42aa-abb3-389a35368d35 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:50.077111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8fe7-bfa2-42aa-abb3-389a35368d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:50.077436 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8fe7-bfa2-42aa-abb3-389a35368d35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:50.092231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb8fe7-bfa2-42aa-abb3-389a35368d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f3eb8fe7-bfa2-42aa-abb3-389a35368d35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:50.097639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:50.098554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:50.099398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 220/445] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:50.105511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb8fe7-bfa2-42aa-abb3-389a35368d35 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:50.152645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d2378-542c-46b3-8323-97d1e7fd1e91 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:50.196351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25bd8d-86f2-4249-abdf-4732281133ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:50.196970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25bd8d-86f2-4249-abdf-4732281133ab None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:50.197289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25bd8d-86f2-4249-abdf-4732281133ab None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:50.197560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25bd8d-86f2-4249-abdf-4732281133ab None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:50.198276 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25bd8d-86f2-4249-abdf-4732281133ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:50.198667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25bd8d-86f2-4249-abdf-4732281133ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:50.200462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25bd8d-86f2-4249-abdf-4732281133ab None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:50.209301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 226/446] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:50.215814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25bd8d-86f2-4249-abdf-4732281133ab None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:50.238105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb8fe7-bfa2-42aa-abb3-389a35368d35 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:50.240232 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:50.267822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:50.278816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c7030-7cc9-4ece-a81a-b684ae3d8c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:50.279444 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c7030-7cc9-4ece-a81a-b684ae3d8c27 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:50.279716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c7030-7cc9-4ece-a81a-b684ae3d8c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:50.279980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c7030-7cc9-4ece-a81a-b684ae3d8c27 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:50.280701 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c7030-7cc9-4ece-a81a-b684ae3d8c27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:50.280995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c7030-7cc9-4ece-a81a-b684ae3d8c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:50.282526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c7030-7cc9-4ece-a81a-b684ae3d8c27 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:50.290504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 221/447] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:50.296899 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c7030-7cc9-4ece-a81a-b684ae3d8c27 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:50.322653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25bd8d-86f2-4249-abdf-4732281133ab None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:50.356792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c609-ad0e-41bf-83ea-3fe1abfe345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:50.357364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c609-ad0e-41bf-83ea-3fe1abfe345b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:50.357642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c609-ad0e-41bf-83ea-3fe1abfe345b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:50.357909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c609-ad0e-41bf-83ea-3fe1abfe345b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:50.396595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c7030-7cc9-4ece-a81a-b684ae3d8c27 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:50.428437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937c609-ad0e-41bf-83ea-3fe1abfe345b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:50.429164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1a06c-c496-4f3c-a87b-e7fc0e8ebe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:50.429778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1a06c-c496-4f3c-a87b-e7fc0e8ebe89 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:50.429929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937c609-ad0e-41bf-83ea-3fe1abfe345b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:50.430059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1a06c-c496-4f3c-a87b-e7fc0e8ebe89 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:50.430330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1a06c-c496-4f3c-a87b-e7fc0e8ebe89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:50.451809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:50.489868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:50.500332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1a06c-c496-4f3c-a87b-e7fc0e8ebe89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:50.501845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1a06c-c496-4f3c-a87b-e7fc0e8ebe89 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:50.530423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 227/448] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:19:50.535996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c609-ad0e-41bf-83ea-3fe1abfe345b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:50.603925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 222/449] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:19:50.609519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1a06c-c496-4f3c-a87b-e7fc0e8ebe89 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:50.634754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c609-ad0e-41bf-83ea-3fe1abfe345b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:50.655264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:50.669551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52979a5-aee8-4ac2-8765-0dd9ede7da9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:50.670185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52979a5-aee8-4ac2-8765-0dd9ede7da9f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:50.670464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52979a5-aee8-4ac2-8765-0dd9ede7da9f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:50.670737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52979a5-aee8-4ac2-8765-0dd9ede7da9f None admin] PATH_INFO: `/v3/projects/75ff8d8e50894a1db12ad71f3510dfd6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:50.673224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52979a5-aee8-4ac2-8765-0dd9ede7da9f None admin] RBAC: Authorizing `identity:get_project(project_id=75ff8d8e50894a1db12ad71f3510dfd6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:50.673512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52979a5-aee8-4ac2-8765-0dd9ede7da9f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:50.675358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 228/450] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:50 2022] GET /identity/v3/projects/75ff8d8e50894a1db12ad71f3510dfd6 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:50.680733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52979a5-aee8-4ac2-8765-0dd9ede7da9f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:50.698978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:50.708086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1a06c-c496-4f3c-a87b-e7fc0e8ebe89 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:50.742569 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a2481-303b-4880-a086-cfc7299d7a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:50.743204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a2481-303b-4880-a086-cfc7299d7a62 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:50.743473 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a2481-303b-4880-a086-cfc7299d7a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:50.743747 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a2481-303b-4880-a086-cfc7299d7a62 None admin] PATH_INFO: `/v3/projects/4fd381b007244ca79e5e671f37551f9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:50.744894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a2481-303b-4880-a086-cfc7299d7a62 None admin] RBAC: Authorizing `identity:get_project(project_id=4fd381b007244ca79e5e671f37551f9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:50.747070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a2481-303b-4880-a086-cfc7299d7a62 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:50.748866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 223/451] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:19:50 2022] GET /identity/v3/projects/4fd381b007244ca79e5e671f37551f9a => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:50.754061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a2481-303b-4880-a086-cfc7299d7a62 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:50.781529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52979a5-aee8-4ac2-8765-0dd9ede7da9f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:50.815426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2932c-10da-4824-930e-562bacb3a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:50.816257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2932c-10da-4824-930e-562bacb3a7dc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:50.816535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2932c-10da-4824-930e-562bacb3a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:50.816808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2932c-10da-4824-930e-562bacb3a7dc None admin] PATH_INFO: `/v3/groups/2660c160f4684879a52b74d3aac26d46` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:50.818000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2932c-10da-4824-930e-562bacb3a7dc None admin] RBAC: Authorizing `identity:get_group(group_id=2660c160f4684879a52b74d3aac26d46)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:50.819445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2932c-10da-4824-930e-562bacb3a7dc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:50.821345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 229/452] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:50 2022] GET /identity/v3/groups/2660c160f4684879a52b74d3aac26d46 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:50.827301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2932c-10da-4824-930e-562bacb3a7dc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:50.852998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a2481-303b-4880-a086-cfc7299d7a62 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:50.881374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:50.887746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f062760-0e18-48db-9057-a93c060d4d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:50.888376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f062760-0e18-48db-9057-a93c060d4d10 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:50.888700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f062760-0e18-48db-9057-a93c060d4d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:50.888970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f062760-0e18-48db-9057-a93c060d4d10 None admin] PATH_INFO: `/v3/groups/6ba1f72a208d4d44b16d7c41991f009f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:50.890169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f062760-0e18-48db-9057-a93c060d4d10 None admin] RBAC: Authorizing `identity:get_group(group_id=6ba1f72a208d4d44b16d7c41991f009f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:50.902294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f062760-0e18-48db-9057-a93c060d4d10 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:50.902294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 224/453] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 05:19:50 2022] GET /identity/v3/groups/6ba1f72a208d4d44b16d7c41991f009f => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:50.902294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f062760-0e18-48db-9057-a93c060d4d10 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:50.925572 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2932c-10da-4824-930e-562bacb3a7dc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:50.927035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:50.958509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a159f23-4701-439b-b864-090cedd0b9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:50.959124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a159f23-4701-439b-b864-090cedd0b9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:50.959401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a159f23-4701-439b-b864-090cedd0b9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:50.959677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a159f23-4701-439b-b864-090cedd0b9a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:50.960461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a159f23-4701-439b-b864-090cedd0b9a3 None admin] RBAC: Adding query filter params (group.id=2660c160f4684879a52b74d3aac26d46, role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=75ff8d8e50894a1db12ad71f3510dfd6) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:50.960768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a159f23-4701-439b-b864-090cedd0b9a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:50.962248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a159f23-4701-439b-b864-090cedd0b9a3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:50.968518 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 230/454] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 05:19:50 2022] GET /identity/v3/role_assignments?group.id=2660c160f4684879a52b74d3aac26d46&scope.project.id=75ff8d8e50894a1db12ad71f3510dfd6&role.id=57a86ff4c9de433399662eebf6893065 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:51.002717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f062760-0e18-48db-9057-a93c060d4d10 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:51.039076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ef4e5-a73d-4bf9-9620-ce598a398b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:51.039706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef4e5-a73d-4bf9-9620-ce598a398b1d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:51.039984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef4e5-a73d-4bf9-9620-ce598a398b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:51.040257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef4e5-a73d-4bf9-9620-ce598a398b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:51.041064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ef4e5-a73d-4bf9-9620-ce598a398b1d None admin] RBAC: Adding query filter params (group.id=6ba1f72a208d4d44b16d7c41991f009f, role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7, scope.project.id=4fd381b007244ca79e5e671f37551f9a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:51.041393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ef4e5-a73d-4bf9-9620-ce598a398b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:51.042944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ef4e5-a73d-4bf9-9620-ce598a398b1d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:51.049431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 225/455] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 05:19:50 2022] GET /identity/v3/role_assignments?group.id=6ba1f72a208d4d44b16d7c41991f009f&scope.project.id=4fd381b007244ca79e5e671f37551f9a&role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:53.587408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8e147-aa2a-4451-a84e-c9071e3fa58a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:53.587941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8e147-aa2a-4451-a84e-c9071e3fa58a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:53.587941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8e147-aa2a-4451-a84e-c9071e3fa58a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:53.589622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 231/456] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:53.595093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37bacb-1beb-4238-8fd3-ad29a128e7ef None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:53.595484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37bacb-1beb-4238-8fd3-ad29a128e7ef None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:53.595663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37bacb-1beb-4238-8fd3-ad29a128e7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:53.622100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2c37bacb-1beb-4238-8fd3-ad29a128e7ef None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:53.623290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2c37bacb-1beb-4238-8fd3-ad29a128e7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:53.716115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 226/457] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:53.763675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8e147-aa2a-4451-a84e-c9071e3fa58a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:53.867570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d4616-c1d0-4f30-b63f-1b2665211c7f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:53.867741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d4616-c1d0-4f30-b63f-1b2665211c7f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:53.868017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d4616-c1d0-4f30-b63f-1b2665211c7f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:53.869660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 227/458] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:53.875694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c5c0-3ba7-4537-a616-3d61a5fbd509 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:53.875976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c5c0-3ba7-4537-a616-3d61a5fbd509 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:53.876252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c5c0-3ba7-4537-a616-3d61a5fbd509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:53.897748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-91c3c5c0-3ba7-4537-a616-3d61a5fbd509 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:53.898933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-91c3c5c0-3ba7-4537-a616-3d61a5fbd509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:53.916833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:53.921729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8e147-aa2a-4451-a84e-c9071e3fa58a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:53.966338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:53.984742 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 228/459] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:54.001460 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacd51e-4b6c-4f1b-beff-0fe9fa263836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:54.002457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacd51e-4b6c-4f1b-beff-0fe9fa263836 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.002932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacd51e-4b6c-4f1b-beff-0fe9fa263836 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.003399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacd51e-4b6c-4f1b-beff-0fe9fa263836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.012573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3c5c0-3ba7-4537-a616-3d61a5fbd509 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:54.028288 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacd51e-4b6c-4f1b-beff-0fe9fa263836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:54.031306 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacd51e-4b6c-4f1b-beff-0fe9fa263836 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-baacd51e-4b6c-4f1b-beff-0fe9fa263836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:19:54.058117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:54.059196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:54.060285 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:19:54.060285 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:19:54.060285 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:54.060285 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:54.062290 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 232/460] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:54.063777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314ac4e-1a3b-4dd0-b7d0-cc2fc327928f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.064256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314ac4e-1a3b-4dd0-b7d0-cc2fc327928f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.064730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314ac4e-1a3b-4dd0-b7d0-cc2fc327928f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.066415 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 233/461] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:54.071187 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314ac4e-1a3b-4dd0-b7d0-cc2fc327928f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:54.143243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3c5c0-3ba7-4537-a616-3d61a5fbd509 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:54.194937 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314ac4e-1a3b-4dd0-b7d0-cc2fc327928f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:54.196287 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f788e-55c0-4a27-9691-741aa2b357c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:54.197243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f788e-55c0-4a27-9691-741aa2b357c7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.198634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f788e-55c0-4a27-9691-741aa2b357c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.198918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f788e-55c0-4a27-9691-741aa2b357c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.212600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f788e-55c0-4a27-9691-741aa2b357c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:54.215980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f788e-55c0-4a27-9691-741aa2b357c7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f35f788e-55c0-4a27-9691-741aa2b357c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:19:54.238312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:54.239228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:54.240084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:19:54.240084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:19:54.240084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:54.240084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:54.240084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 229/462] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:54.240829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7cb7d-1ead-4272-80fb-9e2b67be50ab None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.244422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7cb7d-1ead-4272-80fb-9e2b67be50ab None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.244422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7cb7d-1ead-4272-80fb-9e2b67be50ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.246069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff5701-4053-4359-859c-c3c1440704ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:54.246805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff5701-4053-4359-859c-c3c1440704ec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.247200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff5701-4053-4359-859c-c3c1440704ec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.247551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff5701-4053-4359-859c-c3c1440704ec None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.247941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:54.249201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff5701-4053-4359-859c-c3c1440704ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:54.250512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff5701-4053-4359-859c-c3c1440704ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:54.251916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff5701-4053-4359-859c-c3c1440704ec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:54.263530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-96d7cb7d-1ead-4272-80fb-9e2b67be50ab None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:54.265029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-96d7cb7d-1ead-4272-80fb-9e2b67be50ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:54.266457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 234/463] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:54.267491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff5701-4053-4359-859c-c3c1440704ec None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:54.305363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:54.346006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 230/464] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:54.346826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7cb7d-1ead-4272-80fb-9e2b67be50ab None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:54.382011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff5701-4053-4359-859c-c3c1440704ec None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:54.419057 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3cce1-0554-4855-a1d6-54e2b6a2f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:54.419601 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3cce1-0554-4855-a1d6-54e2b6a2f505 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.419870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3cce1-0554-4855-a1d6-54e2b6a2f505 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.420139 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3cce1-0554-4855-a1d6-54e2b6a2f505 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.420822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3cce1-0554-4855-a1d6-54e2b6a2f505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:54.421116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3cce1-0554-4855-a1d6-54e2b6a2f505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:54.422504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3cce1-0554-4855-a1d6-54e2b6a2f505 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:54.433834 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 235/465] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:54.434808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011e26-dfa5-4eb3-bbde-9d25fa9d1b5c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.435087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011e26-dfa5-4eb3-bbde-9d25fa9d1b5c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.435352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011e26-dfa5-4eb3-bbde-9d25fa9d1b5c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.440611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 236/466] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:54.440611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df011e26-dfa5-4eb3-bbde-9d25fa9d1b5c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:54.462040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7cb7d-1ead-4272-80fb-9e2b67be50ab None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:54.495903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:54.501653 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d712a9a-92a6-4db4-8850-5e6d548e9586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:54.502328 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d712a9a-92a6-4db4-8850-5e6d548e9586 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.502608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d712a9a-92a6-4db4-8850-5e6d548e9586 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.502938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d712a9a-92a6-4db4-8850-5e6d548e9586 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.503638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d712a9a-92a6-4db4-8850-5e6d548e9586 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:54.507506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d712a9a-92a6-4db4-8850-5e6d548e9586 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:54.530455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:54.539462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df011e26-dfa5-4eb3-bbde-9d25fa9d1b5c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:54.573476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea75de3-0d65-4933-8011-26cba3c71fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:54.574189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea75de3-0d65-4933-8011-26cba3c71fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.574461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea75de3-0d65-4933-8011-26cba3c71fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.574727 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea75de3-0d65-4933-8011-26cba3c71fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.584454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea75de3-0d65-4933-8011-26cba3c71fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:54.585917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea75de3-0d65-4933-8011-26cba3c71fc9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-eea75de3-0d65-4933-8011-26cba3c71fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:19:54.600021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:54.601600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:54.602769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:19:54.602769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:19:54.602769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:54.602769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:54.605459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 237/467] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:54.606750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea75de3-0d65-4933-8011-26cba3c71fc9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:54.612085 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 231/468] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:19:54 2022] POST /identity/v3/users => generated 246 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:19:54.613423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104607f0-0184-4460-b89a-65f0d001489b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.613778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104607f0-0184-4460-b89a-65f0d001489b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.614120 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104607f0-0184-4460-b89a-65f0d001489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.645367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-104607f0-0184-4460-b89a-65f0d001489b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:54.646919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-104607f0-0184-4460-b89a-65f0d001489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:54.736639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 232/469] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:54.737866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104607f0-0184-4460-b89a-65f0d001489b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:54.740818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea75de3-0d65-4933-8011-26cba3c71fc9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:54.780812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dfc6e-68fc-4780-9950-8589c2195520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:54.782013 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dfc6e-68fc-4780-9950-8589c2195520 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.782148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dfc6e-68fc-4780-9950-8589c2195520 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.782390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dfc6e-68fc-4780-9950-8589c2195520 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.783091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dfc6e-68fc-4780-9950-8589c2195520 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:54.784969 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7dfc6e-68fc-4780-9950-8589c2195520 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:54.850042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104607f0-0184-4460-b89a-65f0d001489b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:54.868567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:54.872387 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:54.877295 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 238/470] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:19:54 2022] POST /identity/v3/users => generated 248 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:19:54.878220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dfc6e-68fc-4780-9950-8589c2195520 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:54.903493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e9e42-97c2-437a-936a-e6eb6b3decad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:54.904745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e9e42-97c2-437a-936a-e6eb6b3decad None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:54.905690 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e9e42-97c2-437a-936a-e6eb6b3decad None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:54.906140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e9e42-97c2-437a-936a-e6eb6b3decad None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:54.907041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e9e42-97c2-437a-936a-e6eb6b3decad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:54.907523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e9e42-97c2-437a-936a-e6eb6b3decad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:54.911406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e9e42-97c2-437a-936a-e6eb6b3decad None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:54.942273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 233/471] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:54.948202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e9e42-97c2-437a-936a-e6eb6b3decad None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:55.014369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dfc6e-68fc-4780-9950-8589c2195520 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:55.052287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75c02e-3ee3-41ba-9e50-6d28b4fd2a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:55.053270 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c02e-3ee3-41ba-9e50-6d28b4fd2a84 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:55.053552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c02e-3ee3-41ba-9e50-6d28b4fd2a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:55.053870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c02e-3ee3-41ba-9e50-6d28b4fd2a84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:55.059068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e9e42-97c2-437a-936a-e6eb6b3decad None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:55.066304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75c02e-3ee3-41ba-9e50-6d28b4fd2a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:55.068099 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75c02e-3ee3-41ba-9e50-6d28b4fd2a84 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-df75c02e-3ee3-41ba-9e50-6d28b4fd2a84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:19:55.097870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:55.098781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:55.099644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:19:55.099644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:19:55.099644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:55.099644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:55.099644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 239/472] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:55.107024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75c02e-3ee3-41ba-9e50-6d28b4fd2a84 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:55.108468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040ecda-9858-496a-93fe-9c9e18a8ec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:55.109691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040ecda-9858-496a-93fe-9c9e18a8ec80 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:55.111136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040ecda-9858-496a-93fe-9c9e18a8ec80 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:55.111609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040ecda-9858-496a-93fe-9c9e18a8ec80 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:55.112622 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040ecda-9858-496a-93fe-9c9e18a8ec80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:55.114394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040ecda-9858-496a-93fe-9c9e18a8ec80 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:55.181369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:55.234568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 234/473] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:19:54 2022] POST /identity/v3/users => generated 248 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:19:55.234754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75c02e-3ee3-41ba-9e50-6d28b4fd2a84 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:55.257103 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3da11-8197-4151-a03c-65679d5eb8ca None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:55.257454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3da11-8197-4151-a03c-65679d5eb8ca None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:55.257704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3da11-8197-4151-a03c-65679d5eb8ca None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:55.259238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 235/474] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:55.271056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34396fa-499c-4ae0-a008-ebe43b488f86 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:55.271056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34396fa-499c-4ae0-a008-ebe43b488f86 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:55.271056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34396fa-499c-4ae0-a008-ebe43b488f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:55.282279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795a253-9cca-4d4d-b6cf-ae11e9e5f323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:55.282927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795a253-9cca-4d4d-b6cf-ae11e9e5f323 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:55.283214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795a253-9cca-4d4d-b6cf-ae11e9e5f323 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:55.283492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795a253-9cca-4d4d-b6cf-ae11e9e5f323 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:55.284214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795a253-9cca-4d4d-b6cf-ae11e9e5f323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:55.284526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795a253-9cca-4d4d-b6cf-ae11e9e5f323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:55.286004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795a253-9cca-4d4d-b6cf-ae11e9e5f323 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:55.300299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c34396fa-499c-4ae0-a008-ebe43b488f86 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:55.301587 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c34396fa-499c-4ae0-a008-ebe43b488f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:55.303661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 240/475] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:19:55.310154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795a253-9cca-4d4d-b6cf-ae11e9e5f323 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:55.335748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:55.381760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 236/476] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:19:55.409028 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34396fa-499c-4ae0-a008-ebe43b488f86 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:55.503344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795a253-9cca-4d4d-b6cf-ae11e9e5f323 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:55.519496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:55.545452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b1999-66b6-420c-b98e-ef848d65dd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:55.546577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b1999-66b6-420c-b98e-ef848d65dd93 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:55.547222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b1999-66b6-420c-b98e-ef848d65dd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:55.547973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b1999-66b6-420c-b98e-ef848d65dd93 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:55.548663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b1999-66b6-420c-b98e-ef848d65dd93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:55.550169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b1999-66b6-420c-b98e-ef848d65dd93 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:55.569047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34396fa-499c-4ae0-a008-ebe43b488f86 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:55.609377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1c3c9-3b43-4b4c-b803-fa08fe4eae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:55.610061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1c3c9-3b43-4b4c-b803-fa08fe4eae1f None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:55.610346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1c3c9-3b43-4b4c-b803-fa08fe4eae1f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:55.610627 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1c3c9-3b43-4b4c-b803-fa08fe4eae1f None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:55.611402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1c3c9-3b43-4b4c-b803-fa08fe4eae1f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:55.612817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1c3c9-3b43-4b4c-b803-fa08fe4eae1f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:55.631864 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 241/477] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:19:55 2022] POST /identity/v3/users => generated 249 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:19:55.678890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.sql.core [None req-d7b1c3c9-3b43-4b4c-b803-fa08fe4eae1f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 05:19:55.678890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 05:19:55.678890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [parameters: {'id': '3adbe8539aea4de691be92c385bac73d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 05:19:55.678890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80315) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d7b1c3c9-3b43-4b4c-b803-fa08fe4eae1f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jul 28 05:19:55.695793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:19:55.696741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application yield resource Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise self.value Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application session.commit() Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 05:19:55.697697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.flush() Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application compat.raise_( Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 05:19:55.700676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:19:55.702901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:19:55.704973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [parameters: {'id': '3adbe8539aea4de691be92c385bac73d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:55.706920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 05:19:55.714563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:55.716539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 237/478] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 05:19:55 2022] POST /identity/v3/roles => generated 144 bytes in 289 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:19:55.716674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b1999-66b6-420c-b98e-ef848d65dd93 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:55.838644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b1999-66b6-420c-b98e-ef848d65dd93 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:55.884627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692a1a0-9c64-4887-b158-bc5b999bd886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:55.885333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a1a0-9c64-4887-b158-bc5b999bd886 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:55.885700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a1a0-9c64-4887-b158-bc5b999bd886 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:55.885977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a1a0-9c64-4887-b158-bc5b999bd886 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:55.897557 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692a1a0-9c64-4887-b158-bc5b999bd886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2692a1a0-9c64-4887-b158-bc5b999bd886 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:55.903423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:55.905602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:55.907529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 242/479] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:19:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:55.910722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1c3c9-3b43-4b4c-b803-fa08fe4eae1f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:55.949520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:56.030562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1c3c9-3b43-4b4c-b803-fa08fe4eae1f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:56.067170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab460e70-dcb7-47d7-926f-984ae7e6295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:56.067860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460e70-dcb7-47d7-926f-984ae7e6295f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:56.068125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460e70-dcb7-47d7-926f-984ae7e6295f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:56.068395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab460e70-dcb7-47d7-926f-984ae7e6295f None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:56.069121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab460e70-dcb7-47d7-926f-984ae7e6295f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:56.069448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab460e70-dcb7-47d7-926f-984ae7e6295f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:56.070827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab460e70-dcb7-47d7-926f-984ae7e6295f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:56.081435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 238/480] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:56.966313 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b28c-4d8c-4ed2-8a62-7f456b15fa92 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:56.966828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b28c-4d8c-4ed2-8a62-7f456b15fa92 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:56.967102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127b28c-4d8c-4ed2-8a62-7f456b15fa92 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:56.968815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 243/481] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:56.973880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e49b-d0a5-43a4-af36-42f72f739279 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:56.974264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e49b-d0a5-43a4-af36-42f72f739279 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:56.974453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e49b-d0a5-43a4-af36-42f72f739279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:56.994528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1857e49b-d0a5-43a4-af36-42f72f739279 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:56.995885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1857e49b-d0a5-43a4-af36-42f72f739279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:57.082791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 239/482] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:57.118909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127b28c-4d8c-4ed2-8a62-7f456b15fa92 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:57.156424 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:57.262879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127b28c-4d8c-4ed2-8a62-7f456b15fa92 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:57.298373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f90924-1521-4751-8907-e723d136cd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:57.299023 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f90924-1521-4751-8907-e723d136cd11 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:57.299305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f90924-1521-4751-8907-e723d136cd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:57.299578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f90924-1521-4751-8907-e723d136cd11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:57.310847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f90924-1521-4751-8907-e723d136cd11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-85f90924-1521-4751-8907-e723d136cd11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:57.315788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:57.316711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:57.317573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 244/483] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:19:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:57.326470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857e49b-d0a5-43a4-af36-42f72f739279 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:57.352761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:57.461209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857e49b-d0a5-43a4-af36-42f72f739279 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:57.512801 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec450b-e000-4fd9-95ce-61eddf975262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:57.513882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec450b-e000-4fd9-95ce-61eddf975262 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:57.514382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec450b-e000-4fd9-95ce-61eddf975262 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:57.514896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec450b-e000-4fd9-95ce-61eddf975262 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:57.516449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec450b-e000-4fd9-95ce-61eddf975262 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:57.516963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec450b-e000-4fd9-95ce-61eddf975262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:57.518574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec450b-e000-4fd9-95ce-61eddf975262 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:57.527829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 240/484] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:19:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:57.533648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f90924-1521-4751-8907-e723d136cd11 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:57.635432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0875cc-a11c-41cb-82d3-65d15b0f936e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:57.636140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0875cc-a11c-41cb-82d3-65d15b0f936e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:57.636679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0875cc-a11c-41cb-82d3-65d15b0f936e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:57.638273 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:57.638404 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 241/485] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:19:57.650445 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d303-33a7-4fd8-902a-fabf09893f4b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:57.650847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d303-33a7-4fd8-902a-fabf09893f4b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:57.650959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f90924-1521-4751-8907-e723d136cd11 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:57.651769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d303-33a7-4fd8-902a-fabf09893f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:57.671205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d8c0d303-33a7-4fd8-902a-fabf09893f4b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:57.672545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d8c0d303-33a7-4fd8-902a-fabf09893f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:57.688965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a93c34-2b6a-455f-baf8-bcf5ed24d745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:57.689648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a93c34-2b6a-455f-baf8-bcf5ed24d745 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:57.689930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a93c34-2b6a-455f-baf8-bcf5ed24d745 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:57.690205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a93c34-2b6a-455f-baf8-bcf5ed24d745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:57.700823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a93c34-2b6a-455f-baf8-bcf5ed24d745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:57.702336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a93c34-2b6a-455f-baf8-bcf5ed24d745 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d7a93c34-2b6a-455f-baf8-bcf5ed24d745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:19:57.718068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:57.719143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:57.720228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:19:57.720228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:19:57.720228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:57.720228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:57.720228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 245/486] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:57.728902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a93c34-2b6a-455f-baf8-bcf5ed24d745 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:57.787461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 242/487] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:57.816988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1718e3-cd57-4830-be83-38bce99b28de None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:57.817307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1718e3-cd57-4830-be83-38bce99b28de None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:57.817570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1718e3-cd57-4830-be83-38bce99b28de None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:57.819228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 243/488] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:57.824640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1234-23ac-4d14-be5d-043fa82b057a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:57.824925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1234-23ac-4d14-be5d-043fa82b057a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:57.825220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1234-23ac-4d14-be5d-043fa82b057a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:57.841600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a93c34-2b6a-455f-baf8-bcf5ed24d745 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:57.845872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-85ff1234-23ac-4d14-be5d-043fa82b057a None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:57.847044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-85ff1234-23ac-4d14-be5d-043fa82b057a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:57.855715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:57.876988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64ff5b-09b0-42b6-a812-ac9a0197a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:57.877641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ff5b-09b0-42b6-a812-ac9a0197a93e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:57.877924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ff5b-09b0-42b6-a812-ac9a0197a93e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:57.878201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ff5b-09b0-42b6-a812-ac9a0197a93e None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:57.878963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64ff5b-09b0-42b6-a812-ac9a0197a93e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:57.879268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64ff5b-09b0-42b6-a812-ac9a0197a93e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:57.880693 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64ff5b-09b0-42b6-a812-ac9a0197a93e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:57.893631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 246/489] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:57.894200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:57.895828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64ff5b-09b0-42b6-a812-ac9a0197a93e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:57.928503 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 244/490] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:57.929746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1234-23ac-4d14-be5d-043fa82b057a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:58.031989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64ff5b-09b0-42b6-a812-ac9a0197a93e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:58.070378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1234-23ac-4d14-be5d-043fa82b057a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:58.072860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3208e2-c367-4d35-8123-326693a08d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:58.074880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3208e2-c367-4d35-8123-326693a08d66 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.074880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3208e2-c367-4d35-8123-326693a08d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.074880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3208e2-c367-4d35-8123-326693a08d66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.086228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3208e2-c367-4d35-8123-326693a08d66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8c3208e2-c367-4d35-8123-326693a08d66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:58.092259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:58.093403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:19:58.094416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:58.100822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 247/491] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:19:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:58.101838 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3208e2-c367-4d35-8123-326693a08d66 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:58.119225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77806d8b-9415-430d-b376-c80b86f1c981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:58.121201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77806d8b-9415-430d-b376-c80b86f1c981 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.121663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77806d8b-9415-430d-b376-c80b86f1c981 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.122097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77806d8b-9415-430d-b376-c80b86f1c981 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.133287 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77806d8b-9415-430d-b376-c80b86f1c981 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:58.135545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77806d8b-9415-430d-b376-c80b86f1c981 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-77806d8b-9415-430d-b376-c80b86f1c981 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:19:58.156304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:58.157707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:58.158614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:58.158614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:58.158614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:19:58.158614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:19:58.158614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:19:58.158614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:19:58.158614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:19:58.158614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:19:58.158614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:19:58.158614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:58.165297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 245/492] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 05:19:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:58.165297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77806d8b-9415-430d-b376-c80b86f1c981 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:58.172658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:58.178328 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:58.223314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3208e2-c367-4d35-8123-326693a08d66 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:58.259888 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f15a89-c50b-4c4f-9042-bf3ae374e0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:58.260231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f15a89-c50b-4c4f-9042-bf3ae374e0da None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.261071 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f15a89-c50b-4c4f-9042-bf3ae374e0da None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.261413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f15a89-c50b-4c4f-9042-bf3ae374e0da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.272695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f15a89-c50b-4c4f-9042-bf3ae374e0da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-51f15a89-c50b-4c4f-9042-bf3ae374e0da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:58.278994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:58.279922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:19:58.280722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:58.285685 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 248/493] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:58.286705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f15a89-c50b-4c4f-9042-bf3ae374e0da None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:58.306123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77806d8b-9415-430d-b376-c80b86f1c981 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:58.349265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb93ba-9488-450e-8830-666f0419876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:58.350110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb93ba-9488-450e-8830-666f0419876d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.350660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb93ba-9488-450e-8830-666f0419876d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.351380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb93ba-9488-450e-8830-666f0419876d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.352512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb93ba-9488-450e-8830-666f0419876d None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:58.352963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb93ba-9488-450e-8830-666f0419876d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:58.355624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb93ba-9488-450e-8830-666f0419876d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:58.366409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 246/494] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:58.367613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb93ba-9488-450e-8830-666f0419876d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:58.404320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f15a89-c50b-4c4f-9042-bf3ae374e0da None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:58.426655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:58.434130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:58.444042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1908f35-7916-400f-8e53-1594ecc89001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:58.444801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1908f35-7916-400f-8e53-1594ecc89001 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.445224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1908f35-7916-400f-8e53-1594ecc89001 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.445617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1908f35-7916-400f-8e53-1594ecc89001 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.446517 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1908f35-7916-400f-8e53-1594ecc89001 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:58.446922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1908f35-7916-400f-8e53-1594ecc89001 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:58.448835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1908f35-7916-400f-8e53-1594ecc89001 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:58.477680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb93ba-9488-450e-8830-666f0419876d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:58.494343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 249/495] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 05:19:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:58.495675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1908f35-7916-400f-8e53-1594ecc89001 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:58.515075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4eb93-8b3d-46d8-98b5-0c8a5be0e798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:58.516013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4eb93-8b3d-46d8-98b5-0c8a5be0e798 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.516437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4eb93-8b3d-46d8-98b5-0c8a5be0e798 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.516890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4eb93-8b3d-46d8-98b5-0c8a5be0e798 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.518030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4eb93-8b3d-46d8-98b5-0c8a5be0e798 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:58.518482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4eb93-8b3d-46d8-98b5-0c8a5be0e798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:58.519999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4eb93-8b3d-46d8-98b5-0c8a5be0e798 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:58.529957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 247/496] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:58.530961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4eb93-8b3d-46d8-98b5-0c8a5be0e798 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:58.606225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1908f35-7916-400f-8e53-1594ecc89001 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:58.634316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4eb93-8b3d-46d8-98b5-0c8a5be0e798 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:58.639154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929dbf3-ee05-40d7-aa3b-dbeef2783296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:58.639805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929dbf3-ee05-40d7-aa3b-dbeef2783296 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.640072 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929dbf3-ee05-40d7-aa3b-dbeef2783296 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.640340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929dbf3-ee05-40d7-aa3b-dbeef2783296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.650258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929dbf3-ee05-40d7-aa3b-dbeef2783296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:58.652274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929dbf3-ee05-40d7-aa3b-dbeef2783296 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:58.660775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b929dbf3-ee05-40d7-aa3b-dbeef2783296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:19:58.670004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:58.686345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:58.687429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:19:58.687429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:19:58.687429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:58.687429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:58.687781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802df889-82b3-4234-8a7b-126eac858b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:58.687883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 250/497] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:58.687964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df889-82b3-4234-8a7b-126eac858b47 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.687964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df889-82b3-4234-8a7b-126eac858b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.687964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802df889-82b3-4234-8a7b-126eac858b47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.688183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6bcc9-d75b-440d-a515-fe2cbd7ee2c8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.688183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6bcc9-d75b-440d-a515-fe2cbd7ee2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.688183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6bcc9-d75b-440d-a515-fe2cbd7ee2c8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.688183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 251/498] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:58.688183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6bcc9-d75b-440d-a515-fe2cbd7ee2c8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:58.709578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:58.748354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802df889-82b3-4234-8a7b-126eac858b47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:58.749840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802df889-82b3-4234-8a7b-126eac858b47 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:58.780377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6bcc9-d75b-440d-a515-fe2cbd7ee2c8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:58.814338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0cbf5-5cc3-411f-a4b7-3e1d66f7e83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:58.814962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0cbf5-5cc3-411f-a4b7-3e1d66f7e83a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.815238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0cbf5-5cc3-411f-a4b7-3e1d66f7e83a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.815503 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0cbf5-5cc3-411f-a4b7-3e1d66f7e83a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.826104 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0cbf5-5cc3-411f-a4b7-3e1d66f7e83a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:58.827566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0cbf5-5cc3-411f-a4b7-3e1d66f7e83a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-abf0cbf5-5cc3-411f-a4b7-3e1d66f7e83a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:19:58.842485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:58.843338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:58.844216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:19:58.844216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:19:58.844216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:58.844216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:58.844216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 252/499] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:58.844491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0cbf5-5cc3-411f-a4b7-3e1d66f7e83a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:58.851867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 248/500] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:19:58.853581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c25ee1-e821-4d39-9afc-e0db9a7a4ce2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.853869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c25ee1-e821-4d39-9afc-e0db9a7a4ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.854143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c25ee1-e821-4d39-9afc-e0db9a7a4ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.871573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-31c25ee1-e821-4d39-9afc-e0db9a7a4ce2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:58.872666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-31c25ee1-e821-4d39-9afc-e0db9a7a4ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:58.894140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:58.924435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:58.941317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 249/501] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:58.942301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0cbf5-5cc3-411f-a4b7-3e1d66f7e83a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:58.942569 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050eff9d-ccfb-4ba6-8aa5-a4c43335c549 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.942857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050eff9d-ccfb-4ba6-8aa5-a4c43335c549 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.943134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050eff9d-ccfb-4ba6-8aa5-a4c43335c549 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.944390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 250/502] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:19:58.945076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050eff9d-ccfb-4ba6-8aa5-a4c43335c549 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:58.985996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c41f68-562a-44ea-a58f-3ed927096824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:58.986611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c41f68-562a-44ea-a58f-3ed927096824 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:58.986890 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c41f68-562a-44ea-a58f-3ed927096824 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:58.987158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c41f68-562a-44ea-a58f-3ed927096824 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:58.987839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c41f68-562a-44ea-a58f-3ed927096824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:58.988137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c41f68-562a-44ea-a58f-3ed927096824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:58.989525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c41f68-562a-44ea-a58f-3ed927096824 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:59.000736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 253/503] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:59.001365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c41f68-562a-44ea-a58f-3ed927096824 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.047437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050eff9d-ccfb-4ba6-8aa5-a4c43335c549 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.081447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641db35-62ba-4860-8cd8-fc5fead6be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.082106 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641db35-62ba-4860-8cd8-fc5fead6be24 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.082714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641db35-62ba-4860-8cd8-fc5fead6be24 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.082714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641db35-62ba-4860-8cd8-fc5fead6be24 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.083275 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641db35-62ba-4860-8cd8-fc5fead6be24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:59.083580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641db35-62ba-4860-8cd8-fc5fead6be24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:59.084951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641db35-62ba-4860-8cd8-fc5fead6be24 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:59.096531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 251/504] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:59.097866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c766a-a98b-4da5-910b-b0cf6547a62b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.098152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c766a-a98b-4da5-910b-b0cf6547a62b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.098421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c766a-a98b-4da5-910b-b0cf6547a62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.106167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c41f68-562a-44ea-a58f-3ed927096824 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.116924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-819c766a-a98b-4da5-910b-b0cf6547a62b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:19:59.118124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-819c766a-a98b-4da5-910b-b0cf6547a62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:19:59.129657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:59.140048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012269c-8d8e-45cf-9a8c-7217b72e1191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.140775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012269c-8d8e-45cf-9a8c-7217b72e1191 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.141167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012269c-8d8e-45cf-9a8c-7217b72e1191 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.141453 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012269c-8d8e-45cf-9a8c-7217b72e1191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.152438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012269c-8d8e-45cf-9a8c-7217b72e1191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:59.153926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012269c-8d8e-45cf-9a8c-7217b72e1191 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:59.157155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4012269c-8d8e-45cf-9a8c-7217b72e1191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:19:59.170764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:59.171660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:59.173486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:19:59.173486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:19:59.173486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:59.173486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:59.173486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 254/505] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:59.173486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012269c-8d8e-45cf-9a8c-7217b72e1191 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.187988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 252/506] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:19:59.188835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c766a-a98b-4da5-910b-b0cf6547a62b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.278951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012269c-8d8e-45cf-9a8c-7217b72e1191 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.288538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c766a-a98b-4da5-910b-b0cf6547a62b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.311864 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19f88e-3129-47fa-8315-b0b4fec49cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.312509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19f88e-3129-47fa-8315-b0b4fec49cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.312789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19f88e-3129-47fa-8315-b0b4fec49cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.313060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19f88e-3129-47fa-8315-b0b4fec49cc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.322317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ae3e1-6516-4a17-9448-028c15c8e1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.322913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19f88e-3129-47fa-8315-b0b4fec49cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:19:59.323536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ae3e1-6516-4a17-9448-028c15c8e1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.324270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ae3e1-6516-4a17-9448-028c15c8e1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.324541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ae3e1-6516-4a17-9448-028c15c8e1c7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7d19f88e-3129-47fa-8315-b0b4fec49cc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:19:59.328815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:59.329912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 255/507] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:59.330747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19f88e-3129-47fa-8315-b0b4fec49cc8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.335938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ae3e1-6516-4a17-9448-028c15c8e1c7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:59.337419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ae3e1-6516-4a17-9448-028c15c8e1c7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-579ae3e1-6516-4a17-9448-028c15c8e1c7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:19:59.349680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:59.355305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 253/508] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:59.356623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ae3e1-6516-4a17-9448-028c15c8e1c7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.360400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:59.393253 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:59.437782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19f88e-3129-47fa-8315-b0b4fec49cc8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.457420 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ae3e1-6516-4a17-9448-028c15c8e1c7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.471503 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10fc88-ec55-4e9c-94fb-a106a9836ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.472179 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10fc88-ec55-4e9c-94fb-a106a9836ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.472422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10fc88-ec55-4e9c-94fb-a106a9836ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.472694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10fc88-ec55-4e9c-94fb-a106a9836ad1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.480660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10fc88-ec55-4e9c-94fb-a106a9836ad1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:59.482135 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10fc88-ec55-4e9c-94fb-a106a9836ad1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:59.490930 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad205b69-d3f9-473f-98ae-cc648e7e70c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.491538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205b69-d3f9-473f-98ae-cc648e7e70c3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.491812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205b69-d3f9-473f-98ae-cc648e7e70c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.492081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205b69-d3f9-473f-98ae-cc648e7e70c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.492764 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad205b69-d3f9-473f-98ae-cc648e7e70c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:59.493088 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad205b69-d3f9-473f-98ae-cc648e7e70c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:59.494452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad205b69-d3f9-473f-98ae-cc648e7e70c3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5f10fc88-ec55-4e9c-94fb-a106a9836ad1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:19:59.494545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:59.495995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:59.496899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:59.496899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:59.496899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:19:59.496899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:19:59.496899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:19:59.496899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:19:59.496899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:19:59.496899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:19:59.496899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:19:59.496899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:59.500993 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 256/509] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:59.501770 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10fc88-ec55-4e9c-94fb-a106a9836ad1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.507145 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 254/510] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:59.507943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad205b69-d3f9-473f-98ae-cc648e7e70c3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.576605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:59.602099 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10fc88-ec55-4e9c-94fb-a106a9836ad1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.611391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad205b69-d3f9-473f-98ae-cc648e7e70c3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.616713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:59.637157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cababa42-154f-4ced-850e-8be79c6415ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.637808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cababa42-154f-4ced-850e-8be79c6415ef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.638092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cababa42-154f-4ced-850e-8be79c6415ef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.638370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cababa42-154f-4ced-850e-8be79c6415ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.645636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3bc95-a8c5-4146-8a9e-75a302cfb9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.646192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3bc95-a8c5-4146-8a9e-75a302cfb9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.646467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3bc95-a8c5-4146-8a9e-75a302cfb9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.646734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3bc95-a8c5-4146-8a9e-75a302cfb9d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.647435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3bc95-a8c5-4146-8a9e-75a302cfb9d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:59.647731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3bc95-a8c5-4146-8a9e-75a302cfb9d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:59.649089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3bc95-a8c5-4146-8a9e-75a302cfb9d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:59.649737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cababa42-154f-4ced-850e-8be79c6415ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:59.651210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cababa42-154f-4ced-850e-8be79c6415ef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:59.656928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 255/511] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:59.657737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3bc95-a8c5-4146-8a9e-75a302cfb9d2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cababa42-154f-4ced-850e-8be79c6415ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:19:59.665782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:59.667324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:59.668371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:19:59.668371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:19:59.668371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:19:59.668371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:59.668371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 257/512] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:59.668371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cababa42-154f-4ced-850e-8be79c6415ef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.761806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3bc95-a8c5-4146-8a9e-75a302cfb9d2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.770593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cababa42-154f-4ced-850e-8be79c6415ef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.787668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:59.796576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cfda5-94ce-416f-bc14-9b7fc7c0b79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.807842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cfda5-94ce-416f-bc14-9b7fc7c0b79d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.807842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cfda5-94ce-416f-bc14-9b7fc7c0b79d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.807842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cfda5-94ce-416f-bc14-9b7fc7c0b79d None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.807842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cfda5-94ce-416f-bc14-9b7fc7c0b79d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:59.807842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cfda5-94ce-416f-bc14-9b7fc7c0b79d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:59.807842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cfda5-94ce-416f-bc14-9b7fc7c0b79d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:59.808249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7056-caa7-4a8e-9d88-b33e8eca6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.808249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7056-caa7-4a8e-9d88-b33e8eca6513 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.808249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7056-caa7-4a8e-9d88-b33e8eca6513 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.808249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7056-caa7-4a8e-9d88-b33e8eca6513 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.808500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7056-caa7-4a8e-9d88-b33e8eca6513 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:19:59.808500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7056-caa7-4a8e-9d88-b33e8eca6513 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:59.809469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7056-caa7-4a8e-9d88-b33e8eca6513 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:59.827011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 258/513] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:59.827819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7056-caa7-4a8e-9d88-b33e8eca6513 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.837887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 256/514] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:19:59.839356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cfda5-94ce-416f-bc14-9b7fc7c0b79d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.852712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:19:59.925253 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7056-caa7-4a8e-9d88-b33e8eca6513 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.938043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cfda5-94ce-416f-bc14-9b7fc7c0b79d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:19:59.959009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4ca1b-f91d-4fe7-ac8b-b584a0a9a6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.959647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ca1b-f91d-4fe7-ac8b-b584a0a9a6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.959930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ca1b-f91d-4fe7-ac8b-b584a0a9a6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.960205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ca1b-f91d-4fe7-ac8b-b584a0a9a6c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.966776 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4ca1b-f91d-4fe7-ac8b-b584a0a9a6c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:59.968221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4ca1b-f91d-4fe7-ac8b-b584a0a9a6c7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:19:59.971729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf90920-ad2b-4cd5-9174-3a0340aa1305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:19:59.972365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90920-ad2b-4cd5-9174-3a0340aa1305 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:19:59.972645 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90920-ad2b-4cd5-9174-3a0340aa1305 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:19:59.972918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90920-ad2b-4cd5-9174-3a0340aa1305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d2c4ca1b-f91d-4fe7-ac8b-b584a0a9a6c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:19:59.979958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:19:59.980820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:19:59.981710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:19:59.981710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:19:59.981710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:19:59.981710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:19:59.981710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:19:59.981710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:19:59.981710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:19:59.981710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:19:59.981710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 259/515] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:19:59.982185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4ca1b-f91d-4fe7-ac8b-b584a0a9a6c7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:19:59.983150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf90920-ad2b-4cd5-9174-3a0340aa1305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:19:59.984611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf90920-ad2b-4cd5-9174-3a0340aa1305 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9bf90920-ad2b-4cd5-9174-3a0340aa1305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:00.000197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:00.001244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:00.002162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:00.002162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:00.002162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:00.002162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:00.002162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 257/516] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:00.002162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf90920-ad2b-4cd5-9174-3a0340aa1305 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:00.040715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:00.067317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:00.082571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4ca1b-f91d-4fe7-ac8b-b584a0a9a6c7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:00.101195 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf90920-ad2b-4cd5-9174-3a0340aa1305 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:00.116803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399834b-b273-4818-a5ba-19fb78f17301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:00.117465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399834b-b273-4818-a5ba-19fb78f17301 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:00.117760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399834b-b273-4818-a5ba-19fb78f17301 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:00.118036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399834b-b273-4818-a5ba-19fb78f17301 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:00.118755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399834b-b273-4818-a5ba-19fb78f17301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:00.119061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399834b-b273-4818-a5ba-19fb78f17301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:00.121117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399834b-b273-4818-a5ba-19fb78f17301 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:00.132061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 260/517] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:00.132841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399834b-b273-4818-a5ba-19fb78f17301 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:00.133840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43757564-286c-4ddc-a76f-48a47baddf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:00.134461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43757564-286c-4ddc-a76f-48a47baddf08 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:00.134741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43757564-286c-4ddc-a76f-48a47baddf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:00.135014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43757564-286c-4ddc-a76f-48a47baddf08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:00.205937 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43757564-286c-4ddc-a76f-48a47baddf08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:00.207325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43757564-286c-4ddc-a76f-48a47baddf08 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:00.235427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399834b-b273-4818-a5ba-19fb78f17301 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:00.244927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:00.268080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31923336-aec7-4256-9154-294ff3c6f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:00.268737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31923336-aec7-4256-9154-294ff3c6f93d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:00.269020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31923336-aec7-4256-9154-294ff3c6f93d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:00.269318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31923336-aec7-4256-9154-294ff3c6f93d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:00.285593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:00.305551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 258/518] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:20:00.306379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43757564-286c-4ddc-a76f-48a47baddf08 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:00.343689 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31923336-aec7-4256-9154-294ff3c6f93d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:00.345192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31923336-aec7-4256-9154-294ff3c6f93d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:00.402837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43757564-286c-4ddc-a76f-48a47baddf08 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:00.437009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3e1b0-ae4a-4d98-863f-4dc508a110b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:00.437653 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3e1b0-ae4a-4d98-863f-4dc508a110b5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:00.437925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3e1b0-ae4a-4d98-863f-4dc508a110b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:00.443056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3e1b0-ae4a-4d98-863f-4dc508a110b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:00.443056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3e1b0-ae4a-4d98-863f-4dc508a110b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:00.443056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3e1b0-ae4a-4d98-863f-4dc508a110b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:00.443056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3e1b0-ae4a-4d98-863f-4dc508a110b5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:00.443540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 261/519] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:20:00.443540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31923336-aec7-4256-9154-294ff3c6f93d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:00.450968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:00.463683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 259/520] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:00.463683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3e1b0-ae4a-4d98-863f-4dc508a110b5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:00.491513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:00.544714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31923336-aec7-4256-9154-294ff3c6f93d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:00.561785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3e1b0-ae4a-4d98-863f-4dc508a110b5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:00.578365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2941130-f7ce-4729-83fe-0994dd1a85d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:00.578978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941130-f7ce-4729-83fe-0994dd1a85d9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:00.579265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941130-f7ce-4729-83fe-0994dd1a85d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:00.579535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941130-f7ce-4729-83fe-0994dd1a85d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:00.580228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2941130-f7ce-4729-83fe-0994dd1a85d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:00.580624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2941130-f7ce-4729-83fe-0994dd1a85d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:00.582040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2941130-f7ce-4729-83fe-0994dd1a85d9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:00.597989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 262/521] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:00.597989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2941130-f7ce-4729-83fe-0994dd1a85d9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:00.600771 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e78b5-54df-4e01-87a5-b995d5feb39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:00.601424 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e78b5-54df-4e01-87a5-b995d5feb39a None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:00.601699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e78b5-54df-4e01-87a5-b995d5feb39a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:00.601966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e78b5-54df-4e01-87a5-b995d5feb39a None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:00.602633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e78b5-54df-4e01-87a5-b995d5feb39a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:00.604632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e78b5-54df-4e01-87a5-b995d5feb39a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:00.687574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 260/522] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:20:00 2022] POST /identity/v3/users => generated 247 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:00.688388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e78b5-54df-4e01-87a5-b995d5feb39a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:00.704107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2941130-f7ce-4729-83fe-0994dd1a85d9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:00.708280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:00.744947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd47a87-578c-4469-b993-74f3cc0875ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:00.745561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47a87-578c-4469-b993-74f3cc0875ac None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:00.745838 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47a87-578c-4469-b993-74f3cc0875ac None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:00.746111 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47a87-578c-4469-b993-74f3cc0875ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:00.755799 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:00.757734 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd47a87-578c-4469-b993-74f3cc0875ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:00.759315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd47a87-578c-4469-b993-74f3cc0875ac None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2bd47a87-578c-4469-b993-74f3cc0875ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:00.776807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:00.783201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:00.784277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:00.784277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:00.784277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:00.784277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:00.784277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 263/523] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:00.784277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd47a87-578c-4469-b993-74f3cc0875ac None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:00.815579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e78b5-54df-4e01-87a5-b995d5feb39a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:00.859258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38942614-5a94-4ae0-b1c6-3b451797eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:00.859904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942614-5a94-4ae0-b1c6-3b451797eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:00.860180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942614-5a94-4ae0-b1c6-3b451797eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:00.860453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38942614-5a94-4ae0-b1c6-3b451797eaa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:00.876137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38942614-5a94-4ae0-b1c6-3b451797eaa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:00.877681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38942614-5a94-4ae0-b1c6-3b451797eaa2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-38942614-5a94-4ae0-b1c6-3b451797eaa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:00.894621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:00.895602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:00.896523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:00.896523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:00.896523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:00.896523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:00.896523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 261/524] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:00.896798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38942614-5a94-4ae0-b1c6-3b451797eaa2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:00.907154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd47a87-578c-4469-b993-74f3cc0875ac None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:00.943971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308632b-11fd-47ea-b6bd-4c84abdb065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:00.944595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308632b-11fd-47ea-b6bd-4c84abdb065f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:00.944878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308632b-11fd-47ea-b6bd-4c84abdb065f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:00.945171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308632b-11fd-47ea-b6bd-4c84abdb065f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:00.945968 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308632b-11fd-47ea-b6bd-4c84abdb065f None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=531ebc9dee0440888b94a6bf17d7a335) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:00.946279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308632b-11fd-47ea-b6bd-4c84abdb065f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:00.947708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308632b-11fd-47ea-b6bd-4c84abdb065f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:00.961168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 264/525] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:00 2022] GET /identity/v3/role_assignments?user.id=531ebc9dee0440888b94a6bf17d7a335&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:00.961168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308632b-11fd-47ea-b6bd-4c84abdb065f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:00.986946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:01.017251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38942614-5a94-4ae0-b1c6-3b451797eaa2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:01.032067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:01.100251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eb5aa-4c73-4b17-b1a4-7c5309a5596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:01.101610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eb5aa-4c73-4b17-b1a4-7c5309a5596d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:01.102904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eb5aa-4c73-4b17-b1a4-7c5309a5596d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:01.103392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622eb5aa-4c73-4b17-b1a4-7c5309a5596d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:01.115274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622eb5aa-4c73-4b17-b1a4-7c5309a5596d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:01.117299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622eb5aa-4c73-4b17-b1a4-7c5309a5596d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-622eb5aa-4c73-4b17-b1a4-7c5309a5596d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:01.131758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:01.132740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:01.134170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:01.134170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:01.134170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:01.134170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:01.134170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:01.134170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:01.134170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:01.134170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:01.134170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:20:01.134170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:01.140766 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308632b-11fd-47ea-b6bd-4c84abdb065f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:01.142492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 262/526] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:01.143590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eb5aa-4c73-4b17-b1a4-7c5309a5596d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:01.196186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500ba13-87c4-4dc3-a054-715cb2686827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:01.196841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ba13-87c4-4dc3-a054-715cb2686827 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:01.197311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ba13-87c4-4dc3-a054-715cb2686827 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:01.197588 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ba13-87c4-4dc3-a054-715cb2686827 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:01.198987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500ba13-87c4-4dc3-a054-715cb2686827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:01.199294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500ba13-87c4-4dc3-a054-715cb2686827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:01.200695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500ba13-87c4-4dc3-a054-715cb2686827 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:01.223076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 265/527] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:01.224091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500ba13-87c4-4dc3-a054-715cb2686827 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:01.274949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622eb5aa-4c73-4b17-b1a4-7c5309a5596d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:01.312341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dda7f-ab15-4dab-a33d-29d2814b96ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:01.313381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dda7f-ab15-4dab-a33d-29d2814b96ba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:01.313858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dda7f-ab15-4dab-a33d-29d2814b96ba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:01.314325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dda7f-ab15-4dab-a33d-29d2814b96ba None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:01.315312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dda7f-ab15-4dab-a33d-29d2814b96ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:01.315804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dda7f-ab15-4dab-a33d-29d2814b96ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:01.317482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dda7f-ab15-4dab-a33d-29d2814b96ba None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:01.331791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 263/528] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:01.333003 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dda7f-ab15-4dab-a33d-29d2814b96ba None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:01.362925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:01.386718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:01.429111 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500ba13-87c4-4dc3-a054-715cb2686827 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:01.442878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dda7f-ab15-4dab-a33d-29d2814b96ba None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:01.497162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8948e-028e-402f-9990-eed8dea8612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:01.497162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8948e-028e-402f-9990-eed8dea8612e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:01.498174 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8948e-028e-402f-9990-eed8dea8612e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:01.498949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8948e-028e-402f-9990-eed8dea8612e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:01.500405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dd76a-b466-4674-b3fa-136e37a28e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:01.502656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd76a-b466-4674-b3fa-136e37a28e92 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:01.503035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd76a-b466-4674-b3fa-136e37a28e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:01.503403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd76a-b466-4674-b3fa-136e37a28e92 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:01.505359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dd76a-b466-4674-b3fa-136e37a28e92 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:01.508677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dd76a-b466-4674-b3fa-136e37a28e92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:01.511006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dd76a-b466-4674-b3fa-136e37a28e92 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:01.514357 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8948e-028e-402f-9990-eed8dea8612e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:01.515925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8948e-028e-402f-9990-eed8dea8612e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b3c8948e-028e-402f-9990-eed8dea8612e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:01.540972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:01.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:01.543647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:01.543647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:01.543647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:01.543647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:01.543647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:01.543647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:01.543647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:01.543647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:01.547240 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 266/529] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 05:20:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:01.548135 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dd76a-b466-4674-b3fa-136e37a28e92 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:01.549712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 264/530] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:01.552914 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8948e-028e-402f-9990-eed8dea8612e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:01.690816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:01.691428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dd76a-b466-4674-b3fa-136e37a28e92 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:01.711114 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8948e-028e-402f-9990-eed8dea8612e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:01.728941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b426d-d213-4c14-b227-75b47d9a88b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:01.730640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b426d-d213-4c14-b227-75b47d9a88b0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:01.731132 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b426d-d213-4c14-b227-75b47d9a88b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:01.731649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b426d-d213-4c14-b227-75b47d9a88b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:01.739113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b426d-d213-4c14-b227-75b47d9a88b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:01.740812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b426d-d213-4c14-b227-75b47d9a88b0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:01.743146 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9b5b426d-d213-4c14-b227-75b47d9a88b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:01.754640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:01.758901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:01.759800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:01.759800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:01.759800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:01.759800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:01.759800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:01.759800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:01.759800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:01.759800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:01.760240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98d5bc-95dd-419c-a77a-1daf88c65ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:01.760240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98d5bc-95dd-419c-a77a-1daf88c65ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:01.760240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98d5bc-95dd-419c-a77a-1daf88c65ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:01.760240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98d5bc-95dd-419c-a77a-1daf88c65ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:01.761083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 267/531] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:01.761083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b426d-d213-4c14-b227-75b47d9a88b0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:01.850911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98d5bc-95dd-419c-a77a-1daf88c65ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:01.852644 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98d5bc-95dd-419c-a77a-1daf88c65ac1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:01.870087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b426d-d213-4c14-b227-75b47d9a88b0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:01.915910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bcf68-3065-4b5d-a567-9039ecc2d9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:01.917596 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bcf68-3065-4b5d-a567-9039ecc2d9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:01.918033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bcf68-3065-4b5d-a567-9039ecc2d9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:01.918311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bcf68-3065-4b5d-a567-9039ecc2d9a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:01.919339 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bcf68-3065-4b5d-a567-9039ecc2d9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:01.919647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bcf68-3065-4b5d-a567-9039ecc2d9a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:01.921398 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bcf68-3065-4b5d-a567-9039ecc2d9a5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:01.945033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 268/532] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:01.946333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bcf68-3065-4b5d-a567-9039ecc2d9a5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:01.952667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:01.973172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 265/533] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:20:01.973172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98d5bc-95dd-419c-a77a-1daf88c65ac1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:02.016193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:02.060586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bcf68-3065-4b5d-a567-9039ecc2d9a5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:02.075991 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98d5bc-95dd-419c-a77a-1daf88c65ac1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:02.099279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfb522-daa5-4ca2-800d-769283b45550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:02.100248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfb522-daa5-4ca2-800d-769283b45550 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:02.100733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfb522-daa5-4ca2-800d-769283b45550 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:02.101305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfb522-daa5-4ca2-800d-769283b45550 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:02.102286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfb522-daa5-4ca2-800d-769283b45550 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:02.102795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfb522-daa5-4ca2-800d-769283b45550 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:02.104980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfb522-daa5-4ca2-800d-769283b45550 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:02.112337 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0a5ec-cf21-41a8-875c-486932ad018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:02.112949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0a5ec-cf21-41a8-875c-486932ad018c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:02.113266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0a5ec-cf21-41a8-875c-486932ad018c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:02.113557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0a5ec-cf21-41a8-875c-486932ad018c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:02.114323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0a5ec-cf21-41a8-875c-486932ad018c None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=e8753f3c218248abbf8018056c67b923) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:02.114624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0a5ec-cf21-41a8-875c-486932ad018c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:02.116041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0a5ec-cf21-41a8-875c-486932ad018c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:02.119807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 269/534] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:02.121001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfb522-daa5-4ca2-800d-769283b45550 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:02.122089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 266/535] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:01 2022] GET /identity/v3/role_assignments?user.id=e8753f3c218248abbf8018056c67b923&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:02.133546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0a5ec-cf21-41a8-875c-486932ad018c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:02.236279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfb522-daa5-4ca2-800d-769283b45550 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:02.258879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:02.272589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:02.274534 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f63ef7-5287-47da-9078-2c430d3d4420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:02.275196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f63ef7-5287-47da-9078-2c430d3d4420 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:02.275481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f63ef7-5287-47da-9078-2c430d3d4420 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:02.275755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f63ef7-5287-47da-9078-2c430d3d4420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:02.287613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f63ef7-5287-47da-9078-2c430d3d4420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:02.289106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f63ef7-5287-47da-9078-2c430d3d4420 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-09f63ef7-5287-47da-9078-2c430d3d4420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:02.305505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:02.306482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:02.307877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:02.307877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:02.307877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:02.307877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:02.311824 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 270/536] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:02.312708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f63ef7-5287-47da-9078-2c430d3d4420 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:02.346771 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0a5ec-cf21-41a8-875c-486932ad018c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:02.389417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f1c45-3d79-4d6a-bbb4-e282e3e36a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:02.390403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f1c45-3d79-4d6a-bbb4-e282e3e36a13 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:02.390883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f1c45-3d79-4d6a-bbb4-e282e3e36a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:02.391352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f1c45-3d79-4d6a-bbb4-e282e3e36a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:02.392343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f1c45-3d79-4d6a-bbb4-e282e3e36a13 None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=ce47f69d77124bdbbde63374b270b6fb) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:02.392934 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f1c45-3d79-4d6a-bbb4-e282e3e36a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:02.394683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f1c45-3d79-4d6a-bbb4-e282e3e36a13 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:02.408238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 267/537] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:02 2022] GET /identity/v3/role_assignments?user.id=ce47f69d77124bdbbde63374b270b6fb&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:02.418996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f63ef7-5287-47da-9078-2c430d3d4420 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:02.458066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdf45c-1ce5-4e22-b559-c0514f52c48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:02.458703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdf45c-1ce5-4e22-b559-c0514f52c48e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:02.458986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdf45c-1ce5-4e22-b559-c0514f52c48e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:02.459259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdf45c-1ce5-4e22-b559-c0514f52c48e None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:02.459963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdf45c-1ce5-4e22-b559-c0514f52c48e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:02.460270 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdf45c-1ce5-4e22-b559-c0514f52c48e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:02.461717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdf45c-1ce5-4e22-b559-c0514f52c48e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:02.475046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 271/538] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:02.481110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f1c45-3d79-4d6a-bbb4-e282e3e36a13 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:02.622096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f1c45-3d79-4d6a-bbb4-e282e3e36a13 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:02.638503 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:02.661050 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafad78-aa21-42e0-a1a1-6e2e39940cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:02.661950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafad78-aa21-42e0-a1a1-6e2e39940cbd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:02.662375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafad78-aa21-42e0-a1a1-6e2e39940cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:02.662791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafad78-aa21-42e0-a1a1-6e2e39940cbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:02.671363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafad78-aa21-42e0-a1a1-6e2e39940cbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:02.673013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafad78-aa21-42e0-a1a1-6e2e39940cbd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3fafad78-aa21-42e0-a1a1-6e2e39940cbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:02.686257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:02.687370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:02.688459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:02.688459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:02.688459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:02.688459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:02.688459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:02.688459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:02.688459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:02.688459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:02.694461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 268/539] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:02.701162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdf45c-1ce5-4e22-b559-c0514f52c48e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:02.748314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:02.848308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdf45c-1ce5-4e22-b559-c0514f52c48e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:02.889075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c10b8c-ffc2-48b7-80dc-1f5582051eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:02.889737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c10b8c-ffc2-48b7-80dc-1f5582051eec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:02.890019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c10b8c-ffc2-48b7-80dc-1f5582051eec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:02.890293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c10b8c-ffc2-48b7-80dc-1f5582051eec None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:02.891049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c10b8c-ffc2-48b7-80dc-1f5582051eec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:02.891405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c10b8c-ffc2-48b7-80dc-1f5582051eec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:02.892890 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c10b8c-ffc2-48b7-80dc-1f5582051eec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:02.905950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 272/540] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:02.911504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafad78-aa21-42e0-a1a1-6e2e39940cbd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:03.058724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafad78-aa21-42e0-a1a1-6e2e39940cbd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:03.098407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd28169-744b-40ac-9c28-c29a6454d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:03.099445 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28169-744b-40ac-9c28-c29a6454d920 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:03.099972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28169-744b-40ac-9c28-c29a6454d920 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:03.100437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28169-744b-40ac-9c28-c29a6454d920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:03.101460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd28169-744b-40ac-9c28-c29a6454d920 None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=76596e04e82b43cb8b68ee2f5e6dd9e2) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:03.101970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd28169-744b-40ac-9c28-c29a6454d920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:03.103651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd28169-744b-40ac-9c28-c29a6454d920 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:03.113685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 269/541] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:02 2022] GET /identity/v3/role_assignments?user.id=76596e04e82b43cb8b68ee2f5e6dd9e2&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:03.174733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf51328-7370-4d8a-9028-c35d25dad6d2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:03.175061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf51328-7370-4d8a-9028-c35d25dad6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:03.175290 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf51328-7370-4d8a-9028-c35d25dad6d2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:03.182502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 273/542] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:03.191004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689307-607b-4586-b98f-8592ceeaaba4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:03.191608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689307-607b-4586-b98f-8592ceeaaba4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:03.192086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689307-607b-4586-b98f-8592ceeaaba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:03.222290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b3689307-607b-4586-b98f-8592ceeaaba4 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:03.223896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b3689307-607b-4586-b98f-8592ceeaaba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:03.263521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:03.281620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ec631-7f41-4bfb-8b7d-5cb7993661fa None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:03.282133 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ec631-7f41-4bfb-8b7d-5cb7993661fa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:03.282209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ec631-7f41-4bfb-8b7d-5cb7993661fa None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:03.287863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 274/543] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:03.298120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ddfae-fd5e-4384-96f7-bc9bd387ba29 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:03.298717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ddfae-fd5e-4384-96f7-bc9bd387ba29 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:03.299212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ddfae-fd5e-4384-96f7-bc9bd387ba29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:03.321992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 270/544] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:03.328389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-284ddfae-fd5e-4384-96f7-bc9bd387ba29 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:03.329876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-284ddfae-fd5e-4384-96f7-bc9bd387ba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:03.351076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3689307-607b-4586-b98f-8592ceeaaba4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:03.457507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3689307-607b-4586-b98f-8592ceeaaba4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:03.460438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 275/545] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:20:03.493946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ddfae-fd5e-4384-96f7-bc9bd387ba29 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:03.494130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0bd60-5e0e-4454-9ccb-57e7131a61aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:03.494708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0bd60-5e0e-4454-9ccb-57e7131a61aa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:03.494998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0bd60-5e0e-4454-9ccb-57e7131a61aa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:03.495348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0bd60-5e0e-4454-9ccb-57e7131a61aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:03.506134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0bd60-5e0e-4454-9ccb-57e7131a61aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d4b0bd60-5e0e-4454-9ccb-57e7131a61aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:03.511601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:03.512492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:03.513741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 271/546] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:03.518658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0bd60-5e0e-4454-9ccb-57e7131a61aa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:03.543150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:03.581242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:03.687829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ddfae-fd5e-4384-96f7-bc9bd387ba29 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:03.692344 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0bd60-5e0e-4454-9ccb-57e7131a61aa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:03.727663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f54c90-c39c-402d-a287-65051c97f80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:03.727979 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62104bb-1bd9-44b5-a0d3-3e1962f87e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:03.728229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f54c90-c39c-402d-a287-65051c97f80a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:03.728513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f54c90-c39c-402d-a287-65051c97f80a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:03.728617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62104bb-1bd9-44b5-a0d3-3e1962f87e39 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:03.728774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f54c90-c39c-402d-a287-65051c97f80a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:03.728894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62104bb-1bd9-44b5-a0d3-3e1962f87e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:03.729190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62104bb-1bd9-44b5-a0d3-3e1962f87e39 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:03.730041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62104bb-1bd9-44b5-a0d3-3e1962f87e39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:03.730354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62104bb-1bd9-44b5-a0d3-3e1962f87e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:03.731771 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62104bb-1bd9-44b5-a0d3-3e1962f87e39 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:03.740246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f54c90-c39c-402d-a287-65051c97f80a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-66f54c90-c39c-402d-a287-65051c97f80a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:03.745835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:03.746712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:03.747741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 276/547] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:03.751372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 272/548] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:03.756236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f54c90-c39c-402d-a287-65051c97f80a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:03.756352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62104bb-1bd9-44b5-a0d3-3e1962f87e39 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:03.865538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:03.897946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f54c90-c39c-402d-a287-65051c97f80a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:03.959446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a6b96-cfec-41c1-a972-6b941b5ab09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:03.960490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a6b96-cfec-41c1-a972-6b941b5ab09d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:03.960991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a6b96-cfec-41c1-a972-6b941b5ab09d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:03.961508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a6b96-cfec-41c1-a972-6b941b5ab09d None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:03.962927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a6b96-cfec-41c1-a972-6b941b5ab09d None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:03.968602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a6b96-cfec-41c1-a972-6b941b5ab09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:03.968602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a6b96-cfec-41c1-a972-6b941b5ab09d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:03.972117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:03.988693 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 277/549] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:03.989935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a6b96-cfec-41c1-a972-6b941b5ab09d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:03.995238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62104bb-1bd9-44b5-a0d3-3e1962f87e39 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:04.069863 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018458-34c0-4b4c-84ab-ff14f3724d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:04.071005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018458-34c0-4b4c-84ab-ff14f3724d73 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:04.071582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018458-34c0-4b4c-84ab-ff14f3724d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:04.072054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22018458-34c0-4b4c-84ab-ff14f3724d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:04.099245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22018458-34c0-4b4c-84ab-ff14f3724d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:04.101218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22018458-34c0-4b4c-84ab-ff14f3724d73 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:04.118197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a6b96-cfec-41c1-a972-6b941b5ab09d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-22018458-34c0-4b4c-84ab-ff14f3724d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:04.130598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:04.131975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:04.133055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:04.133055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:04.133055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:04.133055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:04.137675 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 273/550] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:04.141948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018458-34c0-4b4c-84ab-ff14f3724d73 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:04.163481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983ccf9-f56b-4e13-895d-0936073a3f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:04.164315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983ccf9-f56b-4e13-895d-0936073a3f84 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:04.164701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983ccf9-f56b-4e13-895d-0936073a3f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:04.165184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983ccf9-f56b-4e13-895d-0936073a3f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:04.178114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983ccf9-f56b-4e13-895d-0936073a3f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:04.179588 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983ccf9-f56b-4e13-895d-0936073a3f84 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:04.201465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c983ccf9-f56b-4e13-895d-0936073a3f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:04.216136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:04.222125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:04.223025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:04.223025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:04.223025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:04.223025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:04.223025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 278/551] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:04.223025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983ccf9-f56b-4e13-895d-0936073a3f84 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:04.340807 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22018458-34c0-4b4c-84ab-ff14f3724d73 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:04.381766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1fd52-cce8-4d00-8725-36fca7bcf49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:04.382441 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1fd52-cce8-4d00-8725-36fca7bcf49d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:04.382723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1fd52-cce8-4d00-8725-36fca7bcf49d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:04.383000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1fd52-cce8-4d00-8725-36fca7bcf49d None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:04.384129 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1fd52-cce8-4d00-8725-36fca7bcf49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:04.384456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1fd52-cce8-4d00-8725-36fca7bcf49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:04.385941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1fd52-cce8-4d00-8725-36fca7bcf49d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:04.400163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 274/552] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:04.406157 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1fd52-cce8-4d00-8725-36fca7bcf49d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:04.409072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:04.466360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983ccf9-f56b-4e13-895d-0936073a3f84 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:04.524524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1fd52-cce8-4d00-8725-36fca7bcf49d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:04.566917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e35053-e78d-44f6-844c-63ddfcdc60b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:04.567561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35053-e78d-44f6-844c-63ddfcdc60b0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:04.567843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35053-e78d-44f6-844c-63ddfcdc60b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:04.568119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35053-e78d-44f6-844c-63ddfcdc60b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:04.569987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20943b-738d-4c14-b7ce-5958d57fff2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:04.570651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20943b-738d-4c14-b7ce-5958d57fff2d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:04.570937 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20943b-738d-4c14-b7ce-5958d57fff2d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:04.571205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20943b-738d-4c14-b7ce-5958d57fff2d None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:04.571906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20943b-738d-4c14-b7ce-5958d57fff2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:04.572208 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20943b-738d-4c14-b7ce-5958d57fff2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:04.573692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20943b-738d-4c14-b7ce-5958d57fff2d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:04.585474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e35053-e78d-44f6-844c-63ddfcdc60b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:04.591403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e35053-e78d-44f6-844c-63ddfcdc60b0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:04.603477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 279/553] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:04.609109 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20943b-738d-4c14-b7ce-5958d57fff2d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-53e35053-e78d-44f6-844c-63ddfcdc60b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:04.620760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:04.621730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:04.623055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:04.623055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:04.623055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:04.623055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:04.623055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:04.623055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:04.623055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:04.623055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:04.623055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:04.623055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:04.623055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 275/554] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:04.630483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e35053-e78d-44f6-844c-63ddfcdc60b0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:04.709799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:04.737780 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:04.767462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20943b-738d-4c14-b7ce-5958d57fff2d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:04.783844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e35053-e78d-44f6-844c-63ddfcdc60b0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:04.813643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688be840-d7aa-4f3d-a644-0a374f28a129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:04.814542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688be840-d7aa-4f3d-a644-0a374f28a129 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:04.814870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688be840-d7aa-4f3d-a644-0a374f28a129 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:04.815150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688be840-d7aa-4f3d-a644-0a374f28a129 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:04.824971 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bb4bb-1f21-4d47-8bf0-5eed3fc0532d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:04.825462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688be840-d7aa-4f3d-a644-0a374f28a129 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:04.826218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bb4bb-1f21-4d47-8bf0-5eed3fc0532d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:04.826699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bb4bb-1f21-4d47-8bf0-5eed3fc0532d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:04.826921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688be840-d7aa-4f3d-a644-0a374f28a129 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:04.827533 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bb4bb-1f21-4d47-8bf0-5eed3fc0532d None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:04.828638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bb4bb-1f21-4d47-8bf0-5eed3fc0532d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:04.829191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bb4bb-1f21-4d47-8bf0-5eed3fc0532d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:04.830875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bb4bb-1f21-4d47-8bf0-5eed3fc0532d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-688be840-d7aa-4f3d-a644-0a374f28a129 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:04.841038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:04.842085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 280/555] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 05:20:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:04.843959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9c687-e6ba-447a-9050-c4fd8f39aaa5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:04.844612 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9c687-e6ba-447a-9050-c4fd8f39aaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:04.844612 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9c687-e6ba-447a-9050-c4fd8f39aaa5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:04.850938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 281/556] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:04.850938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9c687-e6ba-447a-9050-c4fd8f39aaa5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:04.859716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 276/557] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 05:20:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:04.861467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b60fe8-f596-437b-858a-89156c2e656f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:04.862184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b60fe8-f596-437b-858a-89156c2e656f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:04.862681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b60fe8-f596-437b-858a-89156c2e656f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:04.881919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-36b60fe8-f596-437b-858a-89156c2e656f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:04.883545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-36b60fe8-f596-437b-858a-89156c2e656f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:04.958954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 277/558] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:04.962216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9c687-e6ba-447a-9050-c4fd8f39aaa5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:04.962633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b60fe8-f596-437b-858a-89156c2e656f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:04.978287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:04.999474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c537d-36b7-44ac-9429-384868278cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:05.004089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c537d-36b7-44ac-9429-384868278cdf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.004089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c537d-36b7-44ac-9429-384868278cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.004089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c537d-36b7-44ac-9429-384868278cdf None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.004089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c537d-36b7-44ac-9429-384868278cdf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:05.004089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c537d-36b7-44ac-9429-384868278cdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:05.004089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c537d-36b7-44ac-9429-384868278cdf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:05.019507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:05.022934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 282/559] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 05:20:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:05.024196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8c5f-5de9-4901-8f69-066798b992ff None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.024895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8c5f-5de9-4901-8f69-066798b992ff None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.025563 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8c5f-5de9-4901-8f69-066798b992ff None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.029183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 283/560] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:05.029319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f8c5f-5de9-4901-8f69-066798b992ff None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:05.084935 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b60fe8-f596-437b-858a-89156c2e656f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:05.124172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db276edf-6665-47cc-9383-61ff913b315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:05.124703 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db276edf-6665-47cc-9383-61ff913b315b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.124980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db276edf-6665-47cc-9383-61ff913b315b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.125621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db276edf-6665-47cc-9383-61ff913b315b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.139584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f8c5f-5de9-4901-8f69-066798b992ff None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:05.179807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6596b3-b19b-4081-bb63-696270b09295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:05.180447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6596b3-b19b-4081-bb63-696270b09295 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.180736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6596b3-b19b-4081-bb63-696270b09295 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.180985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6596b3-b19b-4081-bb63-696270b09295 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.191710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6596b3-b19b-4081-bb63-696270b09295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4b6596b3-b19b-4081-bb63-696270b09295 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:05.196519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:05.197535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:05.198956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 284/561] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:05.199655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6596b3-b19b-4081-bb63-696270b09295 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:05.206478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db276edf-6665-47cc-9383-61ff913b315b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:05.208064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db276edf-6665-47cc-9383-61ff913b315b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:05.238100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:05.260733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:05.310750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6596b3-b19b-4081-bb63-696270b09295 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:05.318949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 278/562] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:20:05.318949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5eefd-867a-4347-a630-d2bbc955c2fa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.318949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5eefd-867a-4347-a630-d2bbc955c2fa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.318949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5eefd-867a-4347-a630-d2bbc955c2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.336592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0ae5eefd-867a-4347-a630-d2bbc955c2fa None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:05.338039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0ae5eefd-867a-4347-a630-d2bbc955c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:05.349349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513306b0-76d2-4b2d-8231-deede2c8b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:05.349993 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513306b0-76d2-4b2d-8231-deede2c8b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.350437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513306b0-76d2-4b2d-8231-deede2c8b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.350543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513306b0-76d2-4b2d-8231-deede2c8b0f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.361457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513306b0-76d2-4b2d-8231-deede2c8b0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:05.362970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513306b0-76d2-4b2d-8231-deede2c8b0f3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-513306b0-76d2-4b2d-8231-deede2c8b0f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:05.378665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:05.379599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:05.384970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:05.384970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:05.384970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:05.384970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:05.384970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 285/563] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:05.384970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513306b0-76d2-4b2d-8231-deede2c8b0f3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:05.418493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 279/564] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:05.418493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5eefd-867a-4347-a630-d2bbc955c2fa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:05.472713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:05.488794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513306b0-76d2-4b2d-8231-deede2c8b0f3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:05.500204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:05.519149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5eefd-867a-4347-a630-d2bbc955c2fa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:05.522653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f227b-db15-48af-a4a4-a6f9f4d1e4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:05.523271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f227b-db15-48af-a4a4-a6f9f4d1e4ff None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.523716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f227b-db15-48af-a4a4-a6f9f4d1e4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.523991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f227b-db15-48af-a4a4-a6f9f4d1e4ff None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.524698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f227b-db15-48af-a4a4-a6f9f4d1e4ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:05.525002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f227b-db15-48af-a4a4-a6f9f4d1e4ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:05.526500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f227b-db15-48af-a4a4-a6f9f4d1e4ff None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:05.534505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 286/565] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:05.535288 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f227b-db15-48af-a4a4-a6f9f4d1e4ff None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:05.554696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3d8e1-4d1f-46b4-bbe8-ec86118b75da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:05.555332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3d8e1-4d1f-46b4-bbe8-ec86118b75da None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.555615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3d8e1-4d1f-46b4-bbe8-ec86118b75da None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.555886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3d8e1-4d1f-46b4-bbe8-ec86118b75da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.566760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3d8e1-4d1f-46b4-bbe8-ec86118b75da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:05.568220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3d8e1-4d1f-46b4-bbe8-ec86118b75da None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-83b3d8e1-4d1f-46b4-bbe8-ec86118b75da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:05.582833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:05.583725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:05.584763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:05.584763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:05.584763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:05.584763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:05.584763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 280/566] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:05.585243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a53392-1244-4633-b03d-85cd8e83fb1e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.585484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a53392-1244-4633-b03d-85cd8e83fb1e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.585652 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a53392-1244-4633-b03d-85cd8e83fb1e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.587041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 281/567] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:05.589905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a53392-1244-4633-b03d-85cd8e83fb1e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:05.637059 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f227b-db15-48af-a4a4-a6f9f4d1e4ff None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:05.669792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946d79-2c59-475a-9393-9fca1204c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:05.670411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946d79-2c59-475a-9393-9fca1204c925 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.670694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946d79-2c59-475a-9393-9fca1204c925 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.670974 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946d79-2c59-475a-9393-9fca1204c925 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.671661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946d79-2c59-475a-9393-9fca1204c925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:05.671967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946d79-2c59-475a-9393-9fca1204c925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:05.673366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31946d79-2c59-475a-9393-9fca1204c925 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:05.686185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 287/568] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:05.686788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946d79-2c59-475a-9393-9fca1204c925 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:05.691402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a53392-1244-4633-b03d-85cd8e83fb1e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:05.695058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:05.719151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:05.723878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052b161-2bde-4def-8d88-24f63275e673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:05.724507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052b161-2bde-4def-8d88-24f63275e673 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.724782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052b161-2bde-4def-8d88-24f63275e673 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.725049 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052b161-2bde-4def-8d88-24f63275e673 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.736696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052b161-2bde-4def-8d88-24f63275e673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4052b161-2bde-4def-8d88-24f63275e673 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:05.741637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:05.742707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 282/569] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:05.743546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052b161-2bde-4def-8d88-24f63275e673 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:05.790010 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946d79-2c59-475a-9393-9fca1204c925 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:05.822407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a6bd-2d97-42d1-add3-38e940240dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:05.823805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a6bd-2d97-42d1-add3-38e940240dbb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.824085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a6bd-2d97-42d1-add3-38e940240dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.824357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a6bd-2d97-42d1-add3-38e940240dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.835813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a6bd-2d97-42d1-add3-38e940240dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:05.837300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a6bd-2d97-42d1-add3-38e940240dbb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:05.843885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052b161-2bde-4def-8d88-24f63275e673 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7cd7a6bd-2d97-42d1-add3-38e940240dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:05.853237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:05.854671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:05.855575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:05.855575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:05.855575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:05.855575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:05.855575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 288/570] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:05.856358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194b0b9-595d-46ee-8409-c4a566c08422 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.856602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194b0b9-595d-46ee-8409-c4a566c08422 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.856867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194b0b9-595d-46ee-8409-c4a566c08422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.874708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6194b0b9-595d-46ee-8409-c4a566c08422 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:05.875982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6194b0b9-595d-46ee-8409-c4a566c08422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:05.879259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986db85-a8af-402f-8115-3f94b9914da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:05.879870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986db85-a8af-402f-8115-3f94b9914da8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:05.880146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986db85-a8af-402f-8115-3f94b9914da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:05.880416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986db85-a8af-402f-8115-3f94b9914da8 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:05.881150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986db85-a8af-402f-8115-3f94b9914da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:05.881449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986db85-a8af-402f-8115-3f94b9914da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:05.882832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986db85-a8af-402f-8115-3f94b9914da8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:05.894277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 283/571] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:05.894998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986db85-a8af-402f-8115-3f94b9914da8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:05.931512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:05.945241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 289/572] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:05.946102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194b0b9-595d-46ee-8409-c4a566c08422 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:05.946545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:05.993438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986db85-a8af-402f-8115-3f94b9914da8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.027952 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2801a-e12a-4799-97e7-ed97ec268ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.028584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2801a-e12a-4799-97e7-ed97ec268ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.028861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2801a-e12a-4799-97e7-ed97ec268ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.029138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2801a-e12a-4799-97e7-ed97ec268ea5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.035617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2801a-e12a-4799-97e7-ed97ec268ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:06.037052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2801a-e12a-4799-97e7-ed97ec268ea5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:06.046976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194b0b9-595d-46ee-8409-c4a566c08422 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b0a2801a-e12a-4799-97e7-ed97ec268ea5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:06.048530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:06.049514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:06.050438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:06.050438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:06.050438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:06.050438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:06.050438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:06.050438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:06.050438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:06.050438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:06.050438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 284/573] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:06.050438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2801a-e12a-4799-97e7-ed97ec268ea5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:06.086198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641c3da-0ab5-47a2-9ffa-b016522c85bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.086813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641c3da-0ab5-47a2-9ffa-b016522c85bc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.087088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641c3da-0ab5-47a2-9ffa-b016522c85bc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.087351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641c3da-0ab5-47a2-9ffa-b016522c85bc None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.088121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641c3da-0ab5-47a2-9ffa-b016522c85bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:06.088600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641c3da-0ab5-47a2-9ffa-b016522c85bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:06.090816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641c3da-0ab5-47a2-9ffa-b016522c85bc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:06.099198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 290/574] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:06.099981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641c3da-0ab5-47a2-9ffa-b016522c85bc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:06.151484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:06.156286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2801a-e12a-4799-97e7-ed97ec268ea5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.171876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:06.192215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b144eb-ef5d-4120-955d-60b4ff557d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.192810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b144eb-ef5d-4120-955d-60b4ff557d73 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.193094 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b144eb-ef5d-4120-955d-60b4ff557d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.193391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b144eb-ef5d-4120-955d-60b4ff557d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.194084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b144eb-ef5d-4120-955d-60b4ff557d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:06.194385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b144eb-ef5d-4120-955d-60b4ff557d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:06.195904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b144eb-ef5d-4120-955d-60b4ff557d73 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:06.201898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641c3da-0ab5-47a2-9ffa-b016522c85bc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.207201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 285/575] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:06.208199 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b144eb-ef5d-4120-955d-60b4ff557d73 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:06.240228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b23fd-1810-42b7-b58f-acff1f794910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.240863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b23fd-1810-42b7-b58f-acff1f794910 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.241163 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b23fd-1810-42b7-b58f-acff1f794910 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.241432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b23fd-1810-42b7-b58f-acff1f794910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.248212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b23fd-1810-42b7-b58f-acff1f794910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:06.249678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b23fd-1810-42b7-b58f-acff1f794910 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d94b23fd-1810-42b7-b58f-acff1f794910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:06.261670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:06.262602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:06.263498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:06.263498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:06.263498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:06.263498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:06.263498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:06.263498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:06.263498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:06.263498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:06.263498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 291/576] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:06.263981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b23fd-1810-42b7-b58f-acff1f794910 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:06.309961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b144eb-ef5d-4120-955d-60b4ff557d73 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.343143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16b137-c48a-4b83-9436-5bfb669cb849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.343770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16b137-c48a-4b83-9436-5bfb669cb849 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.344047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16b137-c48a-4b83-9436-5bfb669cb849 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.344319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16b137-c48a-4b83-9436-5bfb669cb849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.354704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16b137-c48a-4b83-9436-5bfb669cb849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0e16b137-c48a-4b83-9436-5bfb669cb849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:06.359504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:06.360504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:06.361390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 286/577] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:06.362126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16b137-c48a-4b83-9436-5bfb669cb849 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:06.367262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b23fd-1810-42b7-b58f-acff1f794910 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.378346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:06.393848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:06.401241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3d4e-3e33-4b00-9c03-7c7eca1003bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.401907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3d4e-3e33-4b00-9c03-7c7eca1003bf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.402136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3d4e-3e33-4b00-9c03-7c7eca1003bf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.402406 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3d4e-3e33-4b00-9c03-7c7eca1003bf None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.403144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab3d4e-3e33-4b00-9c03-7c7eca1003bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:06.403446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab3d4e-3e33-4b00-9c03-7c7eca1003bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:06.404858 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab3d4e-3e33-4b00-9c03-7c7eca1003bf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:06.417282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 292/578] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:06.418138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3d4e-3e33-4b00-9c03-7c7eca1003bf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:06.465462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16b137-c48a-4b83-9436-5bfb669cb849 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.607162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3d4e-3e33-4b00-9c03-7c7eca1003bf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.609774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc571a-79b2-4851-a857-3a93c97b4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.610409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc571a-79b2-4851-a857-3a93c97b4b05 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.610743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc571a-79b2-4851-a857-3a93c97b4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.611011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc571a-79b2-4851-a857-3a93c97b4b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.621861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc571a-79b2-4851-a857-3a93c97b4b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:06.623312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc571a-79b2-4851-a857-3a93c97b4b05 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-95cc571a-79b2-4851-a857-3a93c97b4b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:06.638395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:06.639265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:06.640779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:06.640779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:06.640779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:06.640779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:06.640779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 287/579] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:06.640779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc571a-79b2-4851-a857-3a93c97b4b05 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:06.644069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95457d08-452b-479a-a664-aba2cd7694a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.644390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457d08-452b-479a-a664-aba2cd7694a8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.644675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457d08-452b-479a-a664-aba2cd7694a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.644950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457d08-452b-479a-a664-aba2cd7694a8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.652199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95457d08-452b-479a-a664-aba2cd7694a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:06.653625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95457d08-452b-479a-a664-aba2cd7694a8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-95457d08-452b-479a-a664-aba2cd7694a8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:06.664946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:06.665989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 293/580] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:20:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:06.666962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95457d08-452b-479a-a664-aba2cd7694a8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:06.696313 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:06.729538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:06.745344 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc571a-79b2-4851-a857-3a93c97b4b05 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.766652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95457d08-452b-479a-a664-aba2cd7694a8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.778222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2c0cb-0285-4100-ae4b-84fc6e5595b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.778834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2c0cb-0285-4100-ae4b-84fc6e5595b8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.779116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2c0cb-0285-4100-ae4b-84fc6e5595b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.779385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2c0cb-0285-4100-ae4b-84fc6e5595b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.780135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2c0cb-0285-4100-ae4b-84fc6e5595b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:06.780443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2c0cb-0285-4100-ae4b-84fc6e5595b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:06.781919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2c0cb-0285-4100-ae4b-84fc6e5595b8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:06.793603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 288/581] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:06.794363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2c0cb-0285-4100-ae4b-84fc6e5595b8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:06.801466 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33bbd1-0893-49d7-8545-229c007f941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.802349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33bbd1-0893-49d7-8545-229c007f941b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.802630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33bbd1-0893-49d7-8545-229c007f941b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.802905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33bbd1-0893-49d7-8545-229c007f941b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.803613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33bbd1-0893-49d7-8545-229c007f941b None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:06.803921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33bbd1-0893-49d7-8545-229c007f941b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:06.805314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33bbd1-0893-49d7-8545-229c007f941b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:06.814070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 294/582] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:06.815126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33bbd1-0893-49d7-8545-229c007f941b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:06.898379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2c0cb-0285-4100-ae4b-84fc6e5595b8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.903942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:06.912288 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33bbd1-0893-49d7-8545-229c007f941b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:06.933579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480949a-a43d-468b-82da-5529a73d24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.934247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480949a-a43d-468b-82da-5529a73d24fa None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.934527 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480949a-a43d-468b-82da-5529a73d24fa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.934797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480949a-a43d-468b-82da-5529a73d24fa None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/531ebc9dee0440888b94a6bf17d7a335/roles/32be7893438b4f25a422f68ef7c24fef` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.948090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb2516-b847-412d-88c4-0b6f7bebbf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:06.948928 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb2516-b847-412d-88c4-0b6f7bebbf18 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:06.949236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb2516-b847-412d-88c4-0b6f7bebbf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:06.949505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb2516-b847-412d-88c4-0b6f7bebbf18 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:06.949658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480949a-a43d-468b-82da-5529a73d24fa None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=531ebc9dee0440888b94a6bf17d7a335, role_id=32be7893438b4f25a422f68ef7c24fef)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:06.950185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb2516-b847-412d-88c4-0b6f7bebbf18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:06.950489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb2516-b847-412d-88c4-0b6f7bebbf18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:06.951110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480949a-a43d-468b-82da-5529a73d24fa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:06.951823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb2516-b847-412d-88c4-0b6f7bebbf18 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:06.953289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:06.963551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 295/583] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:06.966998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb2516-b847-412d-88c4-0b6f7bebbf18 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:07.058373 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 289/584] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:20:06 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/531ebc9dee0440888b94a6bf17d7a335/roles/32be7893438b4f25a422f68ef7c24fef => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:20:07.059195 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480949a-a43d-468b-82da-5529a73d24fa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:07.062220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb2516-b847-412d-88c4-0b6f7bebbf18 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:07.102436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47f926-6dc3-497c-a026-ae1c94e4626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:07.103071 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47f926-6dc3-497c-a026-ae1c94e4626b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:07.103356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47f926-6dc3-497c-a026-ae1c94e4626b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:07.103638 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47f926-6dc3-497c-a026-ae1c94e4626b None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:07.105163 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47f926-6dc3-497c-a026-ae1c94e4626b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:07.105492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47f926-6dc3-497c-a026-ae1c94e4626b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:07.106977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47f926-6dc3-497c-a026-ae1c94e4626b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:07.127441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 296/585] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 05:20:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:07.128602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47f926-6dc3-497c-a026-ae1c94e4626b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:07.142235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:07.189099 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480949a-a43d-468b-82da-5529a73d24fa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:07.231965 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f13660-c5d5-4fb5-815b-9eecd0d48d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:07.232769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f13660-c5d5-4fb5-815b-9eecd0d48d27 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:07.233070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f13660-c5d5-4fb5-815b-9eecd0d48d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:07.233363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f13660-c5d5-4fb5-815b-9eecd0d48d27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:07.234161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f13660-c5d5-4fb5-815b-9eecd0d48d27 None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=ef24fa7356ac455b8994e0e6d1959654) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:07.234472 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f13660-c5d5-4fb5-815b-9eecd0d48d27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:07.235924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f13660-c5d5-4fb5-815b-9eecd0d48d27 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:07.241531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 290/586] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:07 2022] GET /identity/v3/role_assignments?user.id=ef24fa7356ac455b8994e0e6d1959654&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:07.242330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f13660-c5d5-4fb5-815b-9eecd0d48d27 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:07.253561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47f926-6dc3-497c-a026-ae1c94e4626b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:07.308701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11047a-7857-4ef8-8dc9-5ec9df16f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:07.310164 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11047a-7857-4ef8-8dc9-5ec9df16f5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:07.310624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11047a-7857-4ef8-8dc9-5ec9df16f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:07.311330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11047a-7857-4ef8-8dc9-5ec9df16f5d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:07.324332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:07.329160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11047a-7857-4ef8-8dc9-5ec9df16f5d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:07.331636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11047a-7857-4ef8-8dc9-5ec9df16f5d5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9b11047a-7857-4ef8-8dc9-5ec9df16f5d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:07.352281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:07.353305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:07.354235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:07.354235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:07.354235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:07.354235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:07.360003 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 297/587] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:07.360003 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11047a-7857-4ef8-8dc9-5ec9df16f5d5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:07.389483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f13660-c5d5-4fb5-815b-9eecd0d48d27 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:07.436506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80a1ee-0a35-4081-8863-651336710807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:07.437114 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a1ee-0a35-4081-8863-651336710807 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:07.437442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a1ee-0a35-4081-8863-651336710807 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:07.437717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a1ee-0a35-4081-8863-651336710807 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:07.445762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:07.448938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80a1ee-0a35-4081-8863-651336710807 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:07.450454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80a1ee-0a35-4081-8863-651336710807 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2b80a1ee-0a35-4081-8863-651336710807 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:07.465278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:07.466274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:07.467213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:07.467213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:07.467213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:07.467213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:07.467213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:07.467213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:07.467213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:07.467213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:07.467213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:20:07.467213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:07.467213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 291/588] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:20:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:07.467984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80a1ee-0a35-4081-8863-651336710807 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:07.487658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11047a-7857-4ef8-8dc9-5ec9df16f5d5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:07.529920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166d788-5bd9-43bf-a7bd-ecb7caf71e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:07.530820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166d788-5bd9-43bf-a7bd-ecb7caf71e36 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:07.531204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166d788-5bd9-43bf-a7bd-ecb7caf71e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:07.531582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166d788-5bd9-43bf-a7bd-ecb7caf71e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:07.543439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166d788-5bd9-43bf-a7bd-ecb7caf71e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:07.545084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166d788-5bd9-43bf-a7bd-ecb7caf71e36 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a166d788-5bd9-43bf-a7bd-ecb7caf71e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:07.560856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:07.562020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:07.563194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:07.563194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:07.563194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:07.563194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:07.564425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 298/589] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:07.565479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166d788-5bd9-43bf-a7bd-ecb7caf71e36 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:07.605316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80a1ee-0a35-4081-8863-651336710807 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:07.628618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:07.652985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f75527-9798-4020-b57c-5fba74f3ebfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:07.654404 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75527-9798-4020-b57c-5fba74f3ebfb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:07.654857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75527-9798-4020-b57c-5fba74f3ebfb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:07.655280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f75527-9798-4020-b57c-5fba74f3ebfb None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:07.656566 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f75527-9798-4020-b57c-5fba74f3ebfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:07.657063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f75527-9798-4020-b57c-5fba74f3ebfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:07.659361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f75527-9798-4020-b57c-5fba74f3ebfb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:07.676611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 292/590] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:07.677936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f75527-9798-4020-b57c-5fba74f3ebfb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:07.687998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166d788-5bd9-43bf-a7bd-ecb7caf71e36 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:07.703903 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:07.725597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a47d33-43a1-4405-9efb-7d8abdd23c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:07.726250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47d33-43a1-4405-9efb-7d8abdd23c95 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:07.726677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47d33-43a1-4405-9efb-7d8abdd23c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:07.726963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47d33-43a1-4405-9efb-7d8abdd23c95 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:07.727932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a47d33-43a1-4405-9efb-7d8abdd23c95 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:07.728269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a47d33-43a1-4405-9efb-7d8abdd23c95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:07.730439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a47d33-43a1-4405-9efb-7d8abdd23c95 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:07.757170 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 299/591] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 05:20:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:07.757170 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a47d33-43a1-4405-9efb-7d8abdd23c95 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:07.824912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f75527-9798-4020-b57c-5fba74f3ebfb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:07.867077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a47d33-43a1-4405-9efb-7d8abdd23c95 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:07.873681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16783d1-d494-49ec-ab15-9b5d2ac57d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:07.874551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16783d1-d494-49ec-ab15-9b5d2ac57d0c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:07.875025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16783d1-d494-49ec-ab15-9b5d2ac57d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:07.875991 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16783d1-d494-49ec-ab15-9b5d2ac57d0c None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:07.876937 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16783d1-d494-49ec-ab15-9b5d2ac57d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:07.877913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16783d1-d494-49ec-ab15-9b5d2ac57d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:07.880171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16783d1-d494-49ec-ab15-9b5d2ac57d0c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:07.897202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 293/592] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:07.898602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16783d1-d494-49ec-ab15-9b5d2ac57d0c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:07.912246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b659595-c4d5-4c78-9afa-51a8f30bb57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:07.913628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b659595-c4d5-4c78-9afa-51a8f30bb57e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:07.914112 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b659595-c4d5-4c78-9afa-51a8f30bb57e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:07.914825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b659595-c4d5-4c78-9afa-51a8f30bb57e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:07.925479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b659595-c4d5-4c78-9afa-51a8f30bb57e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:07.928136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b659595-c4d5-4c78-9afa-51a8f30bb57e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:07.943119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7b659595-c4d5-4c78-9afa-51a8f30bb57e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:07.944286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:07.945228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:07.946213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:07.946213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:07.946213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:07.946213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:07.946213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:07.946213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:07.946213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:07.946213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:07.946213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:20:07.946213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:07.948863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 300/593] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:07.949920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b659595-c4d5-4c78-9afa-51a8f30bb57e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:07.990682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:08.015760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16783d1-d494-49ec-ab15-9b5d2ac57d0c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:08.055406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d60e75-736d-4827-9500-a86977eb691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:08.056802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d60e75-736d-4827-9500-a86977eb691e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:08.057250 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d60e75-736d-4827-9500-a86977eb691e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:08.057664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d60e75-736d-4827-9500-a86977eb691e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:08.073399 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d60e75-736d-4827-9500-a86977eb691e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:08.075727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d60e75-736d-4827-9500-a86977eb691e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:08.077023 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b659595-c4d5-4c78-9afa-51a8f30bb57e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-03d60e75-736d-4827-9500-a86977eb691e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:08.094816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:08.095936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:08.097047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:08.097047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:08.097047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:08.097047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:08.104243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 294/594] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:08.105252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d60e75-736d-4827-9500-a86977eb691e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:08.122453 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a4b41-2f18-47f5-9b5b-a876f43f6791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:08.123578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a4b41-2f18-47f5-9b5b-a876f43f6791 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:08.124061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a4b41-2f18-47f5-9b5b-a876f43f6791 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:08.124925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a4b41-2f18-47f5-9b5b-a876f43f6791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:08.134566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a4b41-2f18-47f5-9b5b-a876f43f6791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:08.137586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a4b41-2f18-47f5-9b5b-a876f43f6791 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-bd3a4b41-2f18-47f5-9b5b-a876f43f6791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:08.157592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:08.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:08.159773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:08.159773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:08.159773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:08.159773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:08.159773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:08.159773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:08.159773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:08.159773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:08.159773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 301/595] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:08.160368 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a4b41-2f18-47f5-9b5b-a876f43f6791 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:08.228249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:08.241734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d60e75-736d-4827-9500-a86977eb691e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:08.269687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:08.279298 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a4b41-2f18-47f5-9b5b-a876f43f6791 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:08.288350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5c3ff-1ab9-43c3-acbe-0ca2dc5c9588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:08.288972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c3ff-1ab9-43c3-acbe-0ca2dc5c9588 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:08.289287 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c3ff-1ab9-43c3-acbe-0ca2dc5c9588 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:08.289940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c3ff-1ab9-43c3-acbe-0ca2dc5c9588 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:08.290752 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5c3ff-1ab9-43c3-acbe-0ca2dc5c9588 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:08.291080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5c3ff-1ab9-43c3-acbe-0ca2dc5c9588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:08.294695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5c3ff-1ab9-43c3-acbe-0ca2dc5c9588 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:08.318417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524614-8e80-4e5a-a539-81823975207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:08.318746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 295/596] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 05:20:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:08.319581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5c3ff-1ab9-43c3-acbe-0ca2dc5c9588 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:08.319965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524614-8e80-4e5a-a539-81823975207b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:08.320442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524614-8e80-4e5a-a539-81823975207b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:08.320920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1524614-8e80-4e5a-a539-81823975207b None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:08.321869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1524614-8e80-4e5a-a539-81823975207b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:08.322442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1524614-8e80-4e5a-a539-81823975207b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:08.324434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1524614-8e80-4e5a-a539-81823975207b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:08.337053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 302/597] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:08.338748 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524614-8e80-4e5a-a539-81823975207b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:08.438286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5c3ff-1ab9-43c3-acbe-0ca2dc5c9588 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:08.451152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1524614-8e80-4e5a-a539-81823975207b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:08.476066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6014-209c-4b4c-8ded-31a0d6702861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:08.476911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6014-209c-4b4c-8ded-31a0d6702861 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:08.477330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6014-209c-4b4c-8ded-31a0d6702861 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:08.477599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6014-209c-4b4c-8ded-31a0d6702861 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:08.478460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6014-209c-4b4c-8ded-31a0d6702861 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:08.479242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6014-209c-4b4c-8ded-31a0d6702861 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:08.481321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6014-209c-4b4c-8ded-31a0d6702861 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:08.488581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ef24c-2b1a-4eeb-9329-e381fb95cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:08.489250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ef24c-2b1a-4eeb-9329-e381fb95cb90 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:08.489530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ef24c-2b1a-4eeb-9329-e381fb95cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:08.489798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ef24c-2b1a-4eeb-9329-e381fb95cb90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:08.494167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 296/598] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:08.496127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6014-209c-4b4c-8ded-31a0d6702861 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:08.501672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ef24c-2b1a-4eeb-9329-e381fb95cb90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:08.503113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ef24c-2b1a-4eeb-9329-e381fb95cb90 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:08.507785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cf9ef24c-2b1a-4eeb-9329-e381fb95cb90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:08.519342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:08.522373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:08.523550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:08.523550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:08.523550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:08.523550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:08.523550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 303/599] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:08.524254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ef24c-2b1a-4eeb-9329-e381fb95cb90 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:08.528216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:08.606445 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6014-209c-4b4c-8ded-31a0d6702861 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:08.634605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ef24c-2b1a-4eeb-9329-e381fb95cb90 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:08.643483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a59e-30df-4737-8ef0-bbbc9ee5aa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:08.644326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a59e-30df-4737-8ef0-bbbc9ee5aa62 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:08.644823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a59e-30df-4737-8ef0-bbbc9ee5aa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:08.645274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a59e-30df-4737-8ef0-bbbc9ee5aa62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:08.653327 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46a59e-30df-4737-8ef0-bbbc9ee5aa62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:08.655003 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46a59e-30df-4737-8ef0-bbbc9ee5aa62 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ed46a59e-30df-4737-8ef0-bbbc9ee5aa62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:08.668356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:08.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:08.670604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:08.670604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:08.670604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:08.670604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:08.670604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:08.670604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:08.670604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:08.670604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:08.671024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aba84-819c-45ee-951d-74d747e9cf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:08.671159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aba84-819c-45ee-951d-74d747e9cf7a None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:08.671430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aba84-819c-45ee-951d-74d747e9cf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:08.671700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aba84-819c-45ee-951d-74d747e9cf7a None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/e8753f3c218248abbf8018056c67b923/roles/32be7893438b4f25a422f68ef7c24fef` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:08.677777 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 297/600] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:08.678786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a59e-30df-4737-8ef0-bbbc9ee5aa62 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:08.687667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aba84-819c-45ee-951d-74d747e9cf7a None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=e8753f3c218248abbf8018056c67b923, role_id=32be7893438b4f25a422f68ef7c24fef)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:08.689124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aba84-819c-45ee-951d-74d747e9cf7a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:08.750944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:08.770151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 304/601] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:20:08 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/e8753f3c218248abbf8018056c67b923/roles/32be7893438b4f25a422f68ef7c24fef => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:20:08.771666 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aba84-819c-45ee-951d-74d747e9cf7a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:08.788784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a59e-30df-4737-8ef0-bbbc9ee5aa62 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:08.872700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc923-486c-4417-ad11-e6ecbf6c4d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:08.873752 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc923-486c-4417-ad11-e6ecbf6c4d08 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:08.875685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc923-486c-4417-ad11-e6ecbf6c4d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:08.877554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc923-486c-4417-ad11-e6ecbf6c4d08 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:08.878555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfc923-486c-4417-ad11-e6ecbf6c4d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:08.879355 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfc923-486c-4417-ad11-e6ecbf6c4d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:08.881483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:08.882450 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfc923-486c-4417-ad11-e6ecbf6c4d08 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:08.911654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 298/602] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:08.921505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc923-486c-4417-ad11-e6ecbf6c4d08 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:08.973611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aba84-819c-45ee-951d-74d747e9cf7a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:09.013210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe080113-6da6-4b42-9b51-7ee81d6e1c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:09.013938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe080113-6da6-4b42-9b51-7ee81d6e1c1a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:09.014225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe080113-6da6-4b42-9b51-7ee81d6e1c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:09.014501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe080113-6da6-4b42-9b51-7ee81d6e1c1a None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:09.016084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe080113-6da6-4b42-9b51-7ee81d6e1c1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:09.016406 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe080113-6da6-4b42-9b51-7ee81d6e1c1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:09.017920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe080113-6da6-4b42-9b51-7ee81d6e1c1a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:09.038209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 305/603] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:09.046154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe080113-6da6-4b42-9b51-7ee81d6e1c1a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:09.060258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc923-486c-4417-ad11-e6ecbf6c4d08 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:09.094407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:09.112473 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c284a-87db-4357-ad64-16827edd34ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:09.117579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c284a-87db-4357-ad64-16827edd34ef None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:09.117579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c284a-87db-4357-ad64-16827edd34ef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:09.117579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c284a-87db-4357-ad64-16827edd34ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:09.124009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c284a-87db-4357-ad64-16827edd34ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:09.125520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c284a-87db-4357-ad64-16827edd34ef None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-428c284a-87db-4357-ad64-16827edd34ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:09.154030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:09.155001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:09.156282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:09.156282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:09.156282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:09.156282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:09.156282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:09.156282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:09.156282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:09.156282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:09.156282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 299/604] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:09.161084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c284a-87db-4357-ad64-16827edd34ef None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:09.163519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe080113-6da6-4b42-9b51-7ee81d6e1c1a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:09.180897 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:09.219101 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ad666-735d-413d-9bd7-c0c4cb5305ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:09.219993 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ad666-735d-413d-9bd7-c0c4cb5305ac None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:09.220279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ad666-735d-413d-9bd7-c0c4cb5305ac None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:09.220552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ad666-735d-413d-9bd7-c0c4cb5305ac None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/ce47f69d77124bdbbde63374b270b6fb/roles/32be7893438b4f25a422f68ef7c24fef` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:09.241383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ad666-735d-413d-9bd7-c0c4cb5305ac None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=ce47f69d77124bdbbde63374b270b6fb, role_id=32be7893438b4f25a422f68ef7c24fef)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:09.242840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ad666-735d-413d-9bd7-c0c4cb5305ac None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:09.295403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c284a-87db-4357-ad64-16827edd34ef None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:09.332152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abd88d-28c6-4cd9-a75c-73bed917eb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:09.332766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd88d-28c6-4cd9-a75c-73bed917eb67 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:09.333046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd88d-28c6-4cd9-a75c-73bed917eb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:09.333339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd88d-28c6-4cd9-a75c-73bed917eb67 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:09.334091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abd88d-28c6-4cd9-a75c-73bed917eb67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:09.334395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abd88d-28c6-4cd9-a75c-73bed917eb67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:09.335821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abd88d-28c6-4cd9-a75c-73bed917eb67 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:09.347237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 306/605] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:20:09 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/ce47f69d77124bdbbde63374b270b6fb/roles/32be7893438b4f25a422f68ef7c24fef => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:20:09.349016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188319-a49c-47a8-aba2-7da5e4fb1e47 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:09.349709 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188319-a49c-47a8-aba2-7da5e4fb1e47 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:09.356537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188319-a49c-47a8-aba2-7da5e4fb1e47 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:09.357460 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 307/606] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:09.359158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822d802-8189-4b28-a0ce-f3af1acaf440 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:09.359650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822d802-8189-4b28-a0ce-f3af1acaf440 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:09.359848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 300/607] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:09.360335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822d802-8189-4b28-a0ce-f3af1acaf440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:09.366205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d958eae-93de-452a-872d-3bc13ad4c04f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:09.366521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d958eae-93de-452a-872d-3bc13ad4c04f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:09.366744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d958eae-93de-452a-872d-3bc13ad4c04f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:09.368456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 301/608] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:09.373636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d958eae-93de-452a-872d-3bc13ad4c04f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:09.392336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c822d802-8189-4b28-a0ce-f3af1acaf440 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:09.394808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c822d802-8189-4b28-a0ce-f3af1acaf440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:09.443263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:09.504090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 308/609] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:20:09.504090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a42db-75a0-428f-be75-ff46c3060b7c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:09.504090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a42db-75a0-428f-be75-ff46c3060b7c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:09.504090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a42db-75a0-428f-be75-ff46c3060b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:09.526917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d958eae-93de-452a-872d-3bc13ad4c04f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:09.532589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a17a42db-75a0-428f-be75-ff46c3060b7c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:09.534969 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a17a42db-75a0-428f-be75-ff46c3060b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:09.570743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b21a4-91b9-4e5d-8afb-26479ed76150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:09.571421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b21a4-91b9-4e5d-8afb-26479ed76150 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:09.571715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b21a4-91b9-4e5d-8afb-26479ed76150 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:09.571990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b21a4-91b9-4e5d-8afb-26479ed76150 None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/76596e04e82b43cb8b68ee2f5e6dd9e2/roles/32be7893438b4f25a422f68ef7c24fef` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:09.589604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b21a4-91b9-4e5d-8afb-26479ed76150 None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=76596e04e82b43cb8b68ee2f5e6dd9e2, role_id=32be7893438b4f25a422f68ef7c24fef)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:09.591055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b21a4-91b9-4e5d-8afb-26479ed76150 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:09.618430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 309/610] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:09.619833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a42db-75a0-428f-be75-ff46c3060b7c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:09.646407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:09.667137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 302/611] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:20:09 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/76596e04e82b43cb8b68ee2f5e6dd9e2/roles/32be7893438b4f25a422f68ef7c24fef => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:20:09.668425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b21a4-91b9-4e5d-8afb-26479ed76150 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:09.794842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a42db-75a0-428f-be75-ff46c3060b7c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:09.867923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757093e-e7ce-4a7c-9604-12b4bcf8ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:09.868496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757093e-e7ce-4a7c-9604-12b4bcf8ff5f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:09.868769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757093e-e7ce-4a7c-9604-12b4bcf8ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:09.869034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757093e-e7ce-4a7c-9604-12b4bcf8ff5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:09.874359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:09.880037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b21a4-91b9-4e5d-8afb-26479ed76150 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:09.883999 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757093e-e7ce-4a7c-9604-12b4bcf8ff5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0757093e-e7ce-4a7c-9604-12b4bcf8ff5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:09.895370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:09.896309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 310/612] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:09.897192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757093e-e7ce-4a7c-9604-12b4bcf8ff5f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:09.920608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc5c79-fe2a-4269-b52a-4058eb9c99e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:09.921293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5c79-fe2a-4269-b52a-4058eb9c99e2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:09.921584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5c79-fe2a-4269-b52a-4058eb9c99e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:09.921926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5c79-fe2a-4269-b52a-4058eb9c99e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:09.935282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc5c79-fe2a-4269-b52a-4058eb9c99e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d0fc5c79-fe2a-4269-b52a-4058eb9c99e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:09.940442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:09.943900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:09.944762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 303/613] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:09.948981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc5c79-fe2a-4269-b52a-4058eb9c99e2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:10.045787 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:10.077210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757093e-e7ce-4a7c-9604-12b4bcf8ff5f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:10.138793 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64e7fd-8b96-4791-b6a7-ce50d5e46162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:10.140836 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64e7fd-8b96-4791-b6a7-ce50d5e46162 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:10.141117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64e7fd-8b96-4791-b6a7-ce50d5e46162 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:10.141413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64e7fd-8b96-4791-b6a7-ce50d5e46162 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:10.142169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64e7fd-8b96-4791-b6a7-ce50d5e46162 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:10.142476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64e7fd-8b96-4791-b6a7-ce50d5e46162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:10.146090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64e7fd-8b96-4791-b6a7-ce50d5e46162 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:10.157434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc5c79-fe2a-4269-b52a-4058eb9c99e2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:10.167816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 311/614] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:10.178437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64e7fd-8b96-4791-b6a7-ce50d5e46162 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:10.205842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f24f10-4c3c-4803-8ec2-ac06d4603b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:10.206510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24f10-4c3c-4803-8ec2-ac06d4603b77 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:10.206790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24f10-4c3c-4803-8ec2-ac06d4603b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:10.207117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24f10-4c3c-4803-8ec2-ac06d4603b77 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:10.207832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f24f10-4c3c-4803-8ec2-ac06d4603b77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:10.208135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f24f10-4c3c-4803-8ec2-ac06d4603b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:10.211928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f24f10-4c3c-4803-8ec2-ac06d4603b77 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:10.230668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 304/615] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:10.235046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f24f10-4c3c-4803-8ec2-ac06d4603b77 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:10.276380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:10.367001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64e7fd-8b96-4791-b6a7-ce50d5e46162 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:10.421963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f24f10-4c3c-4803-8ec2-ac06d4603b77 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:10.434674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a161f3-5058-479d-a402-04646feb30f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:10.435339 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a161f3-5058-479d-a402-04646feb30f9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:10.435621 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a161f3-5058-479d-a402-04646feb30f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:10.435893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a161f3-5058-479d-a402-04646feb30f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:10.455372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a161f3-5058-479d-a402-04646feb30f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:10.456837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a161f3-5058-479d-a402-04646feb30f9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:10.475747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:10.485586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474aefc-d76c-43f6-b210-2c97fb5a34b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:10.486293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474aefc-d76c-43f6-b210-2c97fb5a34b6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:10.486569 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474aefc-d76c-43f6-b210-2c97fb5a34b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:10.486841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474aefc-d76c-43f6-b210-2c97fb5a34b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-75a161f3-5058-479d-a402-04646feb30f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:10.492711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:10.493644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:10.496257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:10.496257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:10.496257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:10.496257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:10.496257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 312/616] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:10.500468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a161f3-5058-479d-a402-04646feb30f9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:10.522369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474aefc-d76c-43f6-b210-2c97fb5a34b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:10.523924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474aefc-d76c-43f6-b210-2c97fb5a34b6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7474aefc-d76c-43f6-b210-2c97fb5a34b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:10.553217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:10.555310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:10.558305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:10.558305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:10.558305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:10.558305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:10.559927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 305/617] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:10.564775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474aefc-d76c-43f6-b210-2c97fb5a34b6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:10.648892 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:10.649740 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a161f3-5058-479d-a402-04646feb30f9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:10.681356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474aefc-d76c-43f6-b210-2c97fb5a34b6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:10.702399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cad68-6bda-4095-996b-2256b1cd218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:10.703036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cad68-6bda-4095-996b-2256b1cd218b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:10.703320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cad68-6bda-4095-996b-2256b1cd218b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:10.703595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cad68-6bda-4095-996b-2256b1cd218b None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:10.704291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cad68-6bda-4095-996b-2256b1cd218b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:10.704597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cad68-6bda-4095-996b-2256b1cd218b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:10.710449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cad68-6bda-4095-996b-2256b1cd218b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:10.717329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099e355-1206-427f-95d0-78b2fd895a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:10.717952 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099e355-1206-427f-95d0-78b2fd895a22 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:10.718350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099e355-1206-427f-95d0-78b2fd895a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:10.718536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099e355-1206-427f-95d0-78b2fd895a22 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:10.719463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099e355-1206-427f-95d0-78b2fd895a22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:10.719869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099e355-1206-427f-95d0-78b2fd895a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:10.721402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099e355-1206-427f-95d0-78b2fd895a22 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:10.732867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 313/618] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:10.738706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 306/619] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:10.739594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cad68-6bda-4095-996b-2256b1cd218b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:10.743744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099e355-1206-427f-95d0-78b2fd895a22 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:10.859650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:10.905818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099e355-1206-427f-95d0-78b2fd895a22 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:10.943105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b71a49-41a0-4f9b-bd9f-0b0a740321ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:10.943677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71a49-41a0-4f9b-bd9f-0b0a740321ac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:10.943961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71a49-41a0-4f9b-bd9f-0b0a740321ac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:10.944237 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71a49-41a0-4f9b-bd9f-0b0a740321ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:10.951396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:10.952575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b71a49-41a0-4f9b-bd9f-0b0a740321ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:10.954073 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b71a49-41a0-4f9b-bd9f-0b0a740321ac None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-86b71a49-41a0-4f9b-bd9f-0b0a740321ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:10.967636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:10.968616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:10.970000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:10.970000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:10.970000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:10.970000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:10.970000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:10.970000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:10.970000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:10.970000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:10.970000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:10.970000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:10.970678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cad68-6bda-4095-996b-2256b1cd218b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:10.970774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 307/620] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:10.976560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b71a49-41a0-4f9b-bd9f-0b0a740321ac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:11.045885 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db144deb-f103-498b-971c-9e978330dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:11.046560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144deb-f103-498b-971c-9e978330dba1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:11.046843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144deb-f103-498b-971c-9e978330dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:11.047125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144deb-f103-498b-971c-9e978330dba1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:11.062482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db144deb-f103-498b-971c-9e978330dba1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:11.063963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db144deb-f103-498b-971c-9e978330dba1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-db144deb-f103-498b-971c-9e978330dba1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:11.090020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:11.091046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:11.092409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:11.092409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:11.092409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:11.092409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:11.092409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:11.092409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:11.092409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:11.092409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:11.092409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:11.092409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:11.092409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 314/621] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 05:20:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:11.102117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db144deb-f103-498b-971c-9e978330dba1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:11.104054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b71a49-41a0-4f9b-bd9f-0b0a740321ac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:11.139853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e5b41-c061-4183-8db7-92d6e397c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:11.140483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e5b41-c061-4183-8db7-92d6e397c65f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:11.140765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e5b41-c061-4183-8db7-92d6e397c65f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:11.141040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e5b41-c061-4183-8db7-92d6e397c65f None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:11.142421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e5b41-c061-4183-8db7-92d6e397c65f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:11.142968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e5b41-c061-4183-8db7-92d6e397c65f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:11.145400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e5b41-c061-4183-8db7-92d6e397c65f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:11.165928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 308/622] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 05:20:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:11.173498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e5b41-c061-4183-8db7-92d6e397c65f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:11.259955 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:11.320767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e5b41-c061-4183-8db7-92d6e397c65f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:11.360850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee6e9e-83a2-44c5-b109-9366928c9051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:11.361549 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee6e9e-83a2-44c5-b109-9366928c9051 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:11.361827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee6e9e-83a2-44c5-b109-9366928c9051 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:11.362097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee6e9e-83a2-44c5-b109-9366928c9051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:11.373702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee6e9e-83a2-44c5-b109-9366928c9051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:11.375335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee6e9e-83a2-44c5-b109-9366928c9051 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-15ee6e9e-83a2-44c5-b109-9366928c9051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:11.392795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:11.393797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:11.395116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:11.395116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:11.395116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:11.395116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:11.395116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 309/623] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:11.395578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b22f8-8d7d-465e-af5a-212c057341f4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:11.396665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b22f8-8d7d-465e-af5a-212c057341f4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:11.396665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b22f8-8d7d-465e-af5a-212c057341f4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:11.402165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 310/624] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:11.403063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b22f8-8d7d-465e-af5a-212c057341f4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:11.408680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db144deb-f103-498b-971c-9e978330dba1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:11.428811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:11.450894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5b402-6dc5-4bcb-a677-5c709587005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:11.451518 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b402-6dc5-4bcb-a677-5c709587005e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:11.451799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b402-6dc5-4bcb-a677-5c709587005e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:11.452075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b402-6dc5-4bcb-a677-5c709587005e None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:11.452874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5b402-6dc5-4bcb-a677-5c709587005e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:11.453215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5b402-6dc5-4bcb-a677-5c709587005e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:11.454713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5b402-6dc5-4bcb-a677-5c709587005e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:11.474366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 315/625] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 05:20:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:11.475678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f610bd-31c0-4a10-b292-fcabfdd340c5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:11.475965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f610bd-31c0-4a10-b292-fcabfdd340c5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:11.480255 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f610bd-31c0-4a10-b292-fcabfdd340c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:11.495101 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-37f610bd-31c0-4a10-b292-fcabfdd340c5 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:11.496394 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-37f610bd-31c0-4a10-b292-fcabfdd340c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:11.528276 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b22f8-8d7d-465e-af5a-212c057341f4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:11.568890 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 316/626] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:11.569774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f610bd-31c0-4a10-b292-fcabfdd340c5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:11.572000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831356a-8227-4013-b29b-9c6ff154d904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:11.573222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831356a-8227-4013-b29b-9c6ff154d904 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:11.573564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831356a-8227-4013-b29b-9c6ff154d904 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:11.573836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831356a-8227-4013-b29b-9c6ff154d904 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:11.574525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831356a-8227-4013-b29b-9c6ff154d904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:11.574829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831356a-8227-4013-b29b-9c6ff154d904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:11.576251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831356a-8227-4013-b29b-9c6ff154d904 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:11.589899 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 311/627] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:11.592405 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:11.595702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831356a-8227-4013-b29b-9c6ff154d904 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:11.699113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f610bd-31c0-4a10-b292-fcabfdd340c5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:11.706191 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:11.707002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831356a-8227-4013-b29b-9c6ff154d904 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:11.736654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132f1b9-5f9a-43c5-8d73-222a752d3c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:11.737311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132f1b9-5f9a-43c5-8d73-222a752d3c82 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:11.737592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132f1b9-5f9a-43c5-8d73-222a752d3c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:11.737867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132f1b9-5f9a-43c5-8d73-222a752d3c82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:11.743716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5a02c-7996-43c0-af0c-dd765caa83fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:11.745062 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a02c-7996-43c0-af0c-dd765caa83fc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:11.745599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a02c-7996-43c0-af0c-dd765caa83fc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:11.746069 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a02c-7996-43c0-af0c-dd765caa83fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:11.753557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5a02c-7996-43c0-af0c-dd765caa83fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:11.755020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5a02c-7996-43c0-af0c-dd765caa83fc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-dda5a02c-7996-43c0-af0c-dd765caa83fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:11.769824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:11.770838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:11.771731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:11.771731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:11.771731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:11.771731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:11.771731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:11.771731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:11.771731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:11.771731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:11.771731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 312/628] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:11.771731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5a02c-7996-43c0-af0c-dd765caa83fc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:11.800860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:11.820183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132f1b9-5f9a-43c5-8d73-222a752d3c82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:11.821660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132f1b9-5f9a-43c5-8d73-222a752d3c82 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:11.883107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5a02c-7996-43c0-af0c-dd765caa83fc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:11.920946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abd02b-fb08-47e0-ba3e-b9b66814700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:11.921619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abd02b-fb08-47e0-ba3e-b9b66814700d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:11.921898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abd02b-fb08-47e0-ba3e-b9b66814700d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:11.922169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abd02b-fb08-47e0-ba3e-b9b66814700d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:11.932673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 317/629] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:20:11.932673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b8c82-8f49-4676-8389-22d7524e9d66 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:11.932673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b8c82-8f49-4676-8389-22d7524e9d66 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:11.932673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b8c82-8f49-4676-8389-22d7524e9d66 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:11.932673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 318/630] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:11.933973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b8c82-8f49-4676-8389-22d7524e9d66 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:11.939525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abd02b-fb08-47e0-ba3e-b9b66814700d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:11.942285 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-91abd02b-fb08-47e0-ba3e-b9b66814700d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:11.944953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:11.946096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:11.947308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:11.950844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 313/631] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:11.951684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abd02b-fb08-47e0-ba3e-b9b66814700d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:12.036764 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:12.044390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b8c82-8f49-4676-8389-22d7524e9d66 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:12.055019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abd02b-fb08-47e0-ba3e-b9b66814700d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:12.079849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1f88f-2fa4-432d-8791-ae5f50f10772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:12.080450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1f88f-2fa4-432d-8791-ae5f50f10772 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.080729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1f88f-2fa4-432d-8791-ae5f50f10772 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.080996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1f88f-2fa4-432d-8791-ae5f50f10772 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.081783 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1f88f-2fa4-432d-8791-ae5f50f10772 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:12.082080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1f88f-2fa4-432d-8791-ae5f50f10772 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:12.083483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1f88f-2fa4-432d-8791-ae5f50f10772 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:12.091265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600b22b-fe23-46d8-bbb3-5c1a537b806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:12.091898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600b22b-fe23-46d8-bbb3-5c1a537b806c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.092177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600b22b-fe23-46d8-bbb3-5c1a537b806c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.092444 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600b22b-fe23-46d8-bbb3-5c1a537b806c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.094848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 319/632] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:12.096058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a22f3-a019-464f-b4bb-617a5a43882b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.096341 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a22f3-a019-464f-b4bb-617a5a43882b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.096608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a22f3-a019-464f-b4bb-617a5a43882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.102789 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600b22b-fe23-46d8-bbb3-5c1a537b806c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:12.104442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600b22b-fe23-46d8-bbb3-5c1a537b806c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:12.113517 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-405a22f3-a019-464f-b4bb-617a5a43882b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:12.114681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-405a22f3-a019-464f-b4bb-617a5a43882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f600b22b-fe23-46d8-bbb3-5c1a537b806c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:12.119921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:12.121118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:12.122078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:12.122078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:12.122078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:12.122078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:12.122078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 314/633] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:12.122078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600b22b-fe23-46d8-bbb3-5c1a537b806c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:12.174383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:12.182348 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 320/634] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:12.183572 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af91b0-82f9-4bba-9b5a-c44224d7fa13 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.183854 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af91b0-82f9-4bba-9b5a-c44224d7fa13 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.201161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af91b0-82f9-4bba-9b5a-c44224d7fa13 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.201161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 321/635] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:12.201161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af91b0-82f9-4bba-9b5a-c44224d7fa13 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:12.223798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600b22b-fe23-46d8-bbb3-5c1a537b806c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:12.257236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f131c-74b4-44de-9a39-5914535e5e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:12.257849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f131c-74b4-44de-9a39-5914535e5e77 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.258130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f131c-74b4-44de-9a39-5914535e5e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.258404 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f131c-74b4-44de-9a39-5914535e5e77 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.259114 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f131c-74b4-44de-9a39-5914535e5e77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:12.259416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f131c-74b4-44de-9a39-5914535e5e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:12.261381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f131c-74b4-44de-9a39-5914535e5e77 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:12.262692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:12.270331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 315/636] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:12.271115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f131c-74b4-44de-9a39-5914535e5e77 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:12.300381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af91b0-82f9-4bba-9b5a-c44224d7fa13 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:12.334019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7f1ab-3754-4917-a131-7147ff8880d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:12.334613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7f1ab-3754-4917-a131-7147ff8880d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.334889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7f1ab-3754-4917-a131-7147ff8880d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.335165 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7f1ab-3754-4917-a131-7147ff8880d6 None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/ef24fa7356ac455b8994e0e6d1959654/roles/32be7893438b4f25a422f68ef7c24fef` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.349495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7f1ab-3754-4917-a131-7147ff8880d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=ef24fa7356ac455b8994e0e6d1959654, role_id=32be7893438b4f25a422f68ef7c24fef)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:12.350938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7f1ab-3754-4917-a131-7147ff8880d6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:12.368753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f131c-74b4-44de-9a39-5914535e5e77 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:12.401563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c9341-0790-4d27-a548-d757a8b496de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:12.402163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c9341-0790-4d27-a548-d757a8b496de None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.402443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c9341-0790-4d27-a548-d757a8b496de None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.402713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c9341-0790-4d27-a548-d757a8b496de None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.403394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c9341-0790-4d27-a548-d757a8b496de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:12.403695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c9341-0790-4d27-a548-d757a8b496de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:12.405057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c9341-0790-4d27-a548-d757a8b496de None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:12.416406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 316/637] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:12.417667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a833-f2a7-4752-9e07-c7b7b2375165 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.417953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a833-f2a7-4752-9e07-c7b7b2375165 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.418257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a833-f2a7-4752-9e07-c7b7b2375165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.435905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f832a833-f2a7-4752-9e07-c7b7b2375165 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:12.437102 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f832a833-f2a7-4752-9e07-c7b7b2375165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:12.452144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 322/638] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:20:12 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/ef24fa7356ac455b8994e0e6d1959654/roles/32be7893438b4f25a422f68ef7c24fef => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:20:12.452954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7f1ab-3754-4917-a131-7147ff8880d6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:12.501843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:12.513854 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:12.521717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 317/639] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:12.522859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832a833-f2a7-4752-9e07-c7b7b2375165 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:12.590560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7f1ab-3754-4917-a131-7147ff8880d6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:12.634754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404b097-32c1-4db0-900e-c9d1b2456a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:12.635413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404b097-32c1-4db0-900e-c9d1b2456a5e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.635692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404b097-32c1-4db0-900e-c9d1b2456a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.636007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404b097-32c1-4db0-900e-c9d1b2456a5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.640912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832a833-f2a7-4752-9e07-c7b7b2375165 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:12.646386 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404b097-32c1-4db0-900e-c9d1b2456a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7404b097-32c1-4db0-900e-c9d1b2456a5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:12.652336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:12.653404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:12.654400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 323/640] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:12.655103 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404b097-32c1-4db0-900e-c9d1b2456a5e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:12.677835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c3d23-bff1-4fb2-a9e2-ba410a4ae09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:12.678534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c3d23-bff1-4fb2-a9e2-ba410a4ae09b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.678809 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c3d23-bff1-4fb2-a9e2-ba410a4ae09b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.679079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c3d23-bff1-4fb2-a9e2-ba410a4ae09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.691131 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c3d23-bff1-4fb2-a9e2-ba410a4ae09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:12.693631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c3d23-bff1-4fb2-a9e2-ba410a4ae09b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d78c3d23-bff1-4fb2-a9e2-ba410a4ae09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:12.710766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:12.711883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:12.713335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:12.713335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:12.713335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:12.713335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:12.713335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 318/641] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:12.713335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c3d23-bff1-4fb2-a9e2-ba410a4ae09b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:12.757571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:12.764848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404b097-32c1-4db0-900e-c9d1b2456a5e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:12.772057 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:12.801211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24267cb2-efe2-4117-8b06-231c1fb02cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:12.802254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24267cb2-efe2-4117-8b06-231c1fb02cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.802401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24267cb2-efe2-4117-8b06-231c1fb02cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.802659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24267cb2-efe2-4117-8b06-231c1fb02cb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.810033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24267cb2-efe2-4117-8b06-231c1fb02cb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:12.811542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24267cb2-efe2-4117-8b06-231c1fb02cb2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:12.822652 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c3d23-bff1-4fb2-a9e2-ba410a4ae09b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-24267cb2-efe2-4117-8b06-231c1fb02cb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:12.823315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:12.824429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:12.825582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:12.825582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:12.825582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:12.825582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:12.825582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:12.825582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:12.825582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:12.825582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:12.828091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 324/642] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:12.828931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24267cb2-efe2-4117-8b06-231c1fb02cb2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:12.866486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2000f9-5e5e-49c6-87ab-8668046f4202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:12.867045 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2000f9-5e5e-49c6-87ab-8668046f4202 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.867322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2000f9-5e5e-49c6-87ab-8668046f4202 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.867591 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2000f9-5e5e-49c6-87ab-8668046f4202 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.878285 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2000f9-5e5e-49c6-87ab-8668046f4202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6e2000f9-5e5e-49c6-87ab-8668046f4202 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:12.883521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:12.884451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:12.885779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:12.889606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 319/643] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:12.890753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2000f9-5e5e-49c6-87ab-8668046f4202 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:12.938407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24267cb2-efe2-4117-8b06-231c1fb02cb2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:12.973290 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f135ea-d9e6-4f27-8c86-e5c9a94d03f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:12.973909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f135ea-d9e6-4f27-8c86-e5c9a94d03f1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:12.974180 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f135ea-d9e6-4f27-8c86-e5c9a94d03f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:12.974443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f135ea-d9e6-4f27-8c86-e5c9a94d03f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:12.975151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f135ea-d9e6-4f27-8c86-e5c9a94d03f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:12.975449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f135ea-d9e6-4f27-8c86-e5c9a94d03f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:12.976803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f135ea-d9e6-4f27-8c86-e5c9a94d03f1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:12.985036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 325/644] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:12.985036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f135ea-d9e6-4f27-8c86-e5c9a94d03f1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:13.004445 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:13.008532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2000f9-5e5e-49c6-87ab-8668046f4202 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:13.020751 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:13.044814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b0921-81ce-44c3-87bb-e9785a1413ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:13.045417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b0921-81ce-44c3-87bb-e9785a1413ae None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:13.045779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b0921-81ce-44c3-87bb-e9785a1413ae None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:13.046005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b0921-81ce-44c3-87bb-e9785a1413ae None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:13.046685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b0921-81ce-44c3-87bb-e9785a1413ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:13.046982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b0921-81ce-44c3-87bb-e9785a1413ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:13.048356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b0921-81ce-44c3-87bb-e9785a1413ae None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:13.065926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 320/645] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:13.066825 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b0921-81ce-44c3-87bb-e9785a1413ae None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:13.097582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f135ea-d9e6-4f27-8c86-e5c9a94d03f1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:13.134381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915749f-2475-4195-8972-e41d07123831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:13.135044 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915749f-2475-4195-8972-e41d07123831 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:13.135351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915749f-2475-4195-8972-e41d07123831 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:13.135629 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915749f-2475-4195-8972-e41d07123831 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:13.136325 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915749f-2475-4195-8972-e41d07123831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:13.136629 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915749f-2475-4195-8972-e41d07123831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:13.138086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915749f-2475-4195-8972-e41d07123831 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:13.150669 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 326/646] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:13.151542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915749f-2475-4195-8972-e41d07123831 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:13.183521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b0921-81ce-44c3-87bb-e9785a1413ae None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:13.220620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cdf25-e5e2-49e8-98e3-820a2926e549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:13.221280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cdf25-e5e2-49e8-98e3-820a2926e549 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:13.221564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cdf25-e5e2-49e8-98e3-820a2926e549 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:13.221836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cdf25-e5e2-49e8-98e3-820a2926e549 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:13.222547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cdf25-e5e2-49e8-98e3-820a2926e549 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:13.222853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cdf25-e5e2-49e8-98e3-820a2926e549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:13.224220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cdf25-e5e2-49e8-98e3-820a2926e549 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:13.232343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 321/647] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:13.233148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cdf25-e5e2-49e8-98e3-820a2926e549 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:13.250604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:13.256351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:13.264437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915749f-2475-4195-8972-e41d07123831 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:13.299355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a37d5b-c0ca-4da0-a035-ef6a76241f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:13.299997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37d5b-c0ca-4da0-a035-ef6a76241f3f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:13.300290 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37d5b-c0ca-4da0-a035-ef6a76241f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:13.300587 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37d5b-c0ca-4da0-a035-ef6a76241f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:13.310890 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a37d5b-c0ca-4da0-a035-ef6a76241f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:13.312299 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a37d5b-c0ca-4da0-a035-ef6a76241f3f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-27a37d5b-c0ca-4da0-a035-ef6a76241f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:13.328356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:13.329526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:13.330439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:13.330439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:13.330439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:13.330439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:13.330439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 327/648] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:13.330439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a37d5b-c0ca-4da0-a035-ef6a76241f3f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:13.341992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cdf25-e5e2-49e8-98e3-820a2926e549 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:13.378754 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a1cd5-14a0-48e2-b13b-79df0e4a86f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:13.379388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a1cd5-14a0-48e2-b13b-79df0e4a86f2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:13.379683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a1cd5-14a0-48e2-b13b-79df0e4a86f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:13.379934 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a1cd5-14a0-48e2-b13b-79df0e4a86f2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:13.388015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a1cd5-14a0-48e2-b13b-79df0e4a86f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:13.389429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a1cd5-14a0-48e2-b13b-79df0e4a86f2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d39a1cd5-14a0-48e2-b13b-79df0e4a86f2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:13.401649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:13.402785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:13.403945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:13.403945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:13.403945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:13.403945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:13.403945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:13.403945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:13.403945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:13.403945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:13.403945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 05:20:13.403945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:13.407511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 322/649] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:20:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:13.408274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a1cd5-14a0-48e2-b13b-79df0e4a86f2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:13.444401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a37d5b-c0ca-4da0-a035-ef6a76241f3f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:13.480170 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f1293-9800-44b2-bf60-e9d99a875f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:13.480792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f1293-9800-44b2-bf60-e9d99a875f7a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:13.481065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f1293-9800-44b2-bf60-e9d99a875f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:13.481360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f1293-9800-44b2-bf60-e9d99a875f7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:13.482150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f1293-9800-44b2-bf60-e9d99a875f7a None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=531ebc9dee0440888b94a6bf17d7a335) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:13.482457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f1293-9800-44b2-bf60-e9d99a875f7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:13.483886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f1293-9800-44b2-bf60-e9d99a875f7a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:13.501159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 328/650] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:13 2022] GET /identity/v3/role_assignments?user.id=531ebc9dee0440888b94a6bf17d7a335&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:13.501159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f1293-9800-44b2-bf60-e9d99a875f7a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:13.503013 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:13.504885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:13.536707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a1cd5-14a0-48e2-b13b-79df0e4a86f2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:13.594188 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a648bcc-3fce-4511-b182-83f0c19fa47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:13.594838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a648bcc-3fce-4511-b182-83f0c19fa47c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:13.595646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a648bcc-3fce-4511-b182-83f0c19fa47c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:13.595928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a648bcc-3fce-4511-b182-83f0c19fa47c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:13.611831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a648bcc-3fce-4511-b182-83f0c19fa47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:13.613997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a648bcc-3fce-4511-b182-83f0c19fa47c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:13.621406 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f1293-9800-44b2-bf60-e9d99a875f7a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5a648bcc-3fce-4511-b182-83f0c19fa47c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:13.635294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:13.636291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:13.637214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:13.637214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:13.637214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:13.637214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:13.639950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 323/651] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:13.639950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a648bcc-3fce-4511-b182-83f0c19fa47c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:13.664033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eeb54-bef5-48a2-99d4-c5cb62f29607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:13.664814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eeb54-bef5-48a2-99d4-c5cb62f29607 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:13.665240 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eeb54-bef5-48a2-99d4-c5cb62f29607 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:13.665614 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eeb54-bef5-48a2-99d4-c5cb62f29607 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:13.666450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4eeb54-bef5-48a2-99d4-c5cb62f29607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:13.666847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4eeb54-bef5-48a2-99d4-c5cb62f29607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:13.668341 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4eeb54-bef5-48a2-99d4-c5cb62f29607 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:13.686396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 329/652] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:13.687346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eeb54-bef5-48a2-99d4-c5cb62f29607 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:13.769360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a648bcc-3fce-4511-b182-83f0c19fa47c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:13.770511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:13.807999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:13.816887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bae880-6d48-4490-8c54-6e7df3147c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:13.817546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bae880-6d48-4490-8c54-6e7df3147c5a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:13.817820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bae880-6d48-4490-8c54-6e7df3147c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:13.818083 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bae880-6d48-4490-8c54-6e7df3147c5a None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:13.818874 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bae880-6d48-4490-8c54-6e7df3147c5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:13.819170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bae880-6d48-4490-8c54-6e7df3147c5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:13.820639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bae880-6d48-4490-8c54-6e7df3147c5a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:13.831482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eeb54-bef5-48a2-99d4-c5cb62f29607 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:13.840294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 324/653] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 05:20:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:13.841445 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bae880-6d48-4490-8c54-6e7df3147c5a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:13.878904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd5b51-401e-4eb1-a742-2148063ebabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:13.879625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd5b51-401e-4eb1-a742-2148063ebabe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:13.879987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd5b51-401e-4eb1-a742-2148063ebabe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:13.880326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd5b51-401e-4eb1-a742-2148063ebabe None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:13.881118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd5b51-401e-4eb1-a742-2148063ebabe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:13.881522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd5b51-401e-4eb1-a742-2148063ebabe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:13.883391 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd5b51-401e-4eb1-a742-2148063ebabe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:13.898802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 330/654] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:13.899652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd5b51-401e-4eb1-a742-2148063ebabe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:13.964125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bae880-6d48-4490-8c54-6e7df3147c5a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:14.002213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47855889-021f-42fa-9cf3-13bd01c713ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:14.003212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47855889-021f-42fa-9cf3-13bd01c713ed None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:14.003555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47855889-021f-42fa-9cf3-13bd01c713ed None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:14.003893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47855889-021f-42fa-9cf3-13bd01c713ed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:14.013633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47855889-021f-42fa-9cf3-13bd01c713ed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:14.015697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47855889-021f-42fa-9cf3-13bd01c713ed None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:14.023230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd5b51-401e-4eb1-a742-2148063ebabe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-47855889-021f-42fa-9cf3-13bd01c713ed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:14.031231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:14.032260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:14.033244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:14.033244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:14.033244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:14.033244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:14.033244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:14.033244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:14.033244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:14.033244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:14.033244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:20:14.033244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:14.033814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 325/655] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:20:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:14.035049 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47855889-021f-42fa-9cf3-13bd01c713ed None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:14.055925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:14.068470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d43be-b7c3-4a62-a591-849710d5eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:14.069246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d43be-b7c3-4a62-a591-849710d5eda3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:14.069764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d43be-b7c3-4a62-a591-849710d5eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:14.070038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d43be-b7c3-4a62-a591-849710d5eda3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:14.093118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:14.146359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47855889-021f-42fa-9cf3-13bd01c713ed None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:14.160742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d43be-b7c3-4a62-a591-849710d5eda3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:14.166811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d43be-b7c3-4a62-a591-849710d5eda3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:14.190814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da9a49-9415-42cf-a37d-70b21f26adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:14.191611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da9a49-9415-42cf-a37d-70b21f26adc5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:14.192182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da9a49-9415-42cf-a37d-70b21f26adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:14.192300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da9a49-9415-42cf-a37d-70b21f26adc5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:14.200674 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da9a49-9415-42cf-a37d-70b21f26adc5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:14.202300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da9a49-9415-42cf-a37d-70b21f26adc5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-22da9a49-9415-42cf-a37d-70b21f26adc5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:14.214980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:14.216187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:14.217392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:14.217392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:14.217392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:14.217392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:14.217392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:14.217392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:14.217392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:14.217392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:14.217392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 05:20:14.217392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:14.222617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 326/656] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:14.222617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da9a49-9415-42cf-a37d-70b21f26adc5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:14.299830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 331/657] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:20:14.301091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d43be-b7c3-4a62-a591-849710d5eda3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:14.326972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:14.365883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da9a49-9415-42cf-a37d-70b21f26adc5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:14.377168 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:14.402781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc572db-6f0d-41be-a001-01295232adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:14.403404 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc572db-6f0d-41be-a001-01295232adf2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:14.403683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc572db-6f0d-41be-a001-01295232adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:14.403955 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc572db-6f0d-41be-a001-01295232adf2 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:14.404754 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc572db-6f0d-41be-a001-01295232adf2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:14.405059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc572db-6f0d-41be-a001-01295232adf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:14.406885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc572db-6f0d-41be-a001-01295232adf2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:14.408218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d43be-b7c3-4a62-a591-849710d5eda3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:14.426927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 327/658] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 05:20:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:14.427771 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc572db-6f0d-41be-a001-01295232adf2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:14.445584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf2d52-adee-4b94-9deb-2c6595e75f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:14.446528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf2d52-adee-4b94-9deb-2c6595e75f87 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:14.451764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf2d52-adee-4b94-9deb-2c6595e75f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:14.451764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf2d52-adee-4b94-9deb-2c6595e75f87 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:14.451764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf2d52-adee-4b94-9deb-2c6595e75f87 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:14.451764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf2d52-adee-4b94-9deb-2c6595e75f87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:14.451764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf2d52-adee-4b94-9deb-2c6595e75f87 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:14.473828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 332/659] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 05:20:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:14.475004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf2d52-adee-4b94-9deb-2c6595e75f87 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:14.537347 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc572db-6f0d-41be-a001-01295232adf2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:14.575386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a92d2-3931-4002-99fe-45f1602673f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:14.576021 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a92d2-3931-4002-99fe-45f1602673f2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:14.576302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a92d2-3931-4002-99fe-45f1602673f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:14.576573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a92d2-3931-4002-99fe-45f1602673f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:14.578418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:14.589103 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a92d2-3931-4002-99fe-45f1602673f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:14.591103 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a92d2-3931-4002-99fe-45f1602673f2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:14.596135 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf2d52-adee-4b94-9deb-2c6595e75f87 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-af2a92d2-3931-4002-99fe-45f1602673f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:14.606637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:14.607555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:14.608463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:14.608463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:14.608463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:14.608463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:14.608463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 328/660] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:14.608753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a92d2-3931-4002-99fe-45f1602673f2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:14.632932 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:14.636788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cad96-d386-4983-a069-90fb5277fb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:14.637464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cad96-d386-4983-a069-90fb5277fb47 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:14.637746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cad96-d386-4983-a069-90fb5277fb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:14.638021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cad96-d386-4983-a069-90fb5277fb47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:14.706233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cad96-d386-4983-a069-90fb5277fb47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:14.707590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cad96-d386-4983-a069-90fb5277fb47 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:14.717362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a92d2-3931-4002-99fe-45f1602673f2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:14.753488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabebbf-0e3e-45bd-b109-fcbe58d5bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:14.754216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabebbf-0e3e-45bd-b109-fcbe58d5bf7e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:14.754499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabebbf-0e3e-45bd-b109-fcbe58d5bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:14.754880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabebbf-0e3e-45bd-b109-fcbe58d5bf7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:14.790510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:14.813030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 333/661] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:20:14.813030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9815b-a516-4257-aba1-2d6814bc1350 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:14.813030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9815b-a516-4257-aba1-2d6814bc1350 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:14.813030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9815b-a516-4257-aba1-2d6814bc1350 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:14.813030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 334/662] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:14.813030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9815b-a516-4257-aba1-2d6814bc1350 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:14.834649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabebbf-0e3e-45bd-b109-fcbe58d5bf7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:14.836186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabebbf-0e3e-45bd-b109-fcbe58d5bf7e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:14.859477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:14.919318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9815b-a516-4257-aba1-2d6814bc1350 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:14.942841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 329/663] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:20:14.943844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabebbf-0e3e-45bd-b109-fcbe58d5bf7e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:14.959422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5d943-b3af-4796-99a2-b026f54dcdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:14.959964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5d943-b3af-4796-99a2-b026f54dcdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:14.960299 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5d943-b3af-4796-99a2-b026f54dcdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:14.960503 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5d943-b3af-4796-99a2-b026f54dcdc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:14.961296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5d943-b3af-4796-99a2-b026f54dcdc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:14.961509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5d943-b3af-4796-99a2-b026f54dcdc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:14.963395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5d943-b3af-4796-99a2-b026f54dcdc2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:14.975074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 335/664] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:14.976238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b4a3-d5d6-4d7f-9e40-62e8a1fea0bb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:14.976520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b4a3-d5d6-4d7f-9e40-62e8a1fea0bb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:14.976796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b4a3-d5d6-4d7f-9e40-62e8a1fea0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:14.995804 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ba47b4a3-d5d6-4d7f-9e40-62e8a1fea0bb None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:14.996976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba47b4a3-d5d6-4d7f-9e40-62e8a1fea0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:15.038626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:15.059609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabebbf-0e3e-45bd-b109-fcbe58d5bf7e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:15.077330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 336/665] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:15.077330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47b4a3-d5d6-4d7f-9e40-62e8a1fea0bb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.090723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:15.105697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d95f26-0a25-4e83-9fd1-62cac0ffff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:15.106341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d95f26-0a25-4e83-9fd1-62cac0ffff8d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.106618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d95f26-0a25-4e83-9fd1-62cac0ffff8d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.106889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d95f26-0a25-4e83-9fd1-62cac0ffff8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.117294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d95f26-0a25-4e83-9fd1-62cac0ffff8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:15.118773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d95f26-0a25-4e83-9fd1-62cac0ffff8d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f2d95f26-0a25-4e83-9fd1-62cac0ffff8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:15.133624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:15.135418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:15.136583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:15.136583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:15.136583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:15.136583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:15.136583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 330/666] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:15.136583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d95f26-0a25-4e83-9fd1-62cac0ffff8d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.189474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47b4a3-d5d6-4d7f-9e40-62e8a1fea0bb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:15.224020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b112fcc-5770-4e8d-ad8a-11da4c543323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:15.224573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b112fcc-5770-4e8d-ad8a-11da4c543323 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.224848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b112fcc-5770-4e8d-ad8a-11da4c543323 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.225116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b112fcc-5770-4e8d-ad8a-11da4c543323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.235785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b112fcc-5770-4e8d-ad8a-11da4c543323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:15.237305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b112fcc-5770-4e8d-ad8a-11da4c543323 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:15.242609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d95f26-0a25-4e83-9fd1-62cac0ffff8d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8b112fcc-5770-4e8d-ad8a-11da4c543323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:15.253280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:15.254222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:15.255157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:15.255157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:15.255157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:15.255157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:15.255157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 337/667] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:15.255449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b112fcc-5770-4e8d-ad8a-11da4c543323 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.282006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c581eb-02af-4a48-8318-3fa48a50d410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:15.282641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c581eb-02af-4a48-8318-3fa48a50d410 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.282917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c581eb-02af-4a48-8318-3fa48a50d410 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.283191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c581eb-02af-4a48-8318-3fa48a50d410 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.289760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c581eb-02af-4a48-8318-3fa48a50d410 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:15.291987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c581eb-02af-4a48-8318-3fa48a50d410 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-01c581eb-02af-4a48-8318-3fa48a50d410 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:15.304143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:15.305300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:15.306248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:15.306248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:15.306248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:15.306248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:15.306248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:15.306248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:15.306248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:15.306248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:15.306248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 331/668] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:15.306248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c581eb-02af-4a48-8318-3fa48a50d410 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.365899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b112fcc-5770-4e8d-ad8a-11da4c543323 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:15.379257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:15.402110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebff1c-bd73-437f-8acc-89a85de4e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:15.402748 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebff1c-bd73-437f-8acc-89a85de4e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.403030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebff1c-bd73-437f-8acc-89a85de4e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.403300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebff1c-bd73-437f-8acc-89a85de4e2c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.407403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c581eb-02af-4a48-8318-3fa48a50d410 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:15.413551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebff1c-bd73-437f-8acc-89a85de4e2c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:15.418110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-afebff1c-bd73-437f-8acc-89a85de4e2c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:15.420006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:15.420944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:15.421850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 338/669] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:15.422586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebff1c-bd73-437f-8acc-89a85de4e2c7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.449964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adf890-41fa-4abf-9b11-4d51b88ee9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:15.450583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adf890-41fa-4abf-9b11-4d51b88ee9ea None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.450865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adf890-41fa-4abf-9b11-4d51b88ee9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.451137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adf890-41fa-4abf-9b11-4d51b88ee9ea None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.451847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adf890-41fa-4abf-9b11-4d51b88ee9ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:15.452131 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adf890-41fa-4abf-9b11-4d51b88ee9ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:15.453587 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adf890-41fa-4abf-9b11-4d51b88ee9ea None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:15.468408 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 332/670] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:15.469349 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adf890-41fa-4abf-9b11-4d51b88ee9ea None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.517235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:15.533526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebff1c-bd73-437f-8acc-89a85de4e2c7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:15.567534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:15.568474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e1b9f-3bb3-4659-b9b9-d81a7a53157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:15.569098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e1b9f-3bb3-4659-b9b9-d81a7a53157e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.569408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e1b9f-3bb3-4659-b9b9-d81a7a53157e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.569668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e1b9f-3bb3-4659-b9b9-d81a7a53157e None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.570352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e1b9f-3bb3-4659-b9b9-d81a7a53157e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:15.570654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e1b9f-3bb3-4659-b9b9-d81a7a53157e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:15.572074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e1b9f-3bb3-4659-b9b9-d81a7a53157e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:15.577689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adf890-41fa-4abf-9b11-4d51b88ee9ea None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:15.584192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 339/671] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:15.585070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e1b9f-3bb3-4659-b9b9-d81a7a53157e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.618141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a8cf2-a121-44fa-9aa5-ecfa346581f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:15.619460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8cf2-a121-44fa-9aa5-ecfa346581f3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.619749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8cf2-a121-44fa-9aa5-ecfa346581f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.620022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8cf2-a121-44fa-9aa5-ecfa346581f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.620774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a8cf2-a121-44fa-9aa5-ecfa346581f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:15.621079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a8cf2-a121-44fa-9aa5-ecfa346581f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:15.622538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a8cf2-a121-44fa-9aa5-ecfa346581f3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:15.639290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 333/672] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:15.639290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a8cf2-a121-44fa-9aa5-ecfa346581f3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.702454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e1b9f-3bb3-4659-b9b9-d81a7a53157e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:15.739668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a63a6c-8c2c-48cc-9982-d9ee97fbc280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:15.740635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a63a6c-8c2c-48cc-9982-d9ee97fbc280 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.741231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a63a6c-8c2c-48cc-9982-d9ee97fbc280 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.741511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a63a6c-8c2c-48cc-9982-d9ee97fbc280 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.742217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a63a6c-8c2c-48cc-9982-d9ee97fbc280 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:15.742519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a63a6c-8c2c-48cc-9982-d9ee97fbc280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:15.744036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a63a6c-8c2c-48cc-9982-d9ee97fbc280 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:15.747293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a8cf2-a121-44fa-9aa5-ecfa346581f3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:15.756499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 340/673] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:15.756499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a63a6c-8c2c-48cc-9982-d9ee97fbc280 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.765780 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:15.784771 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5cea3-bbbb-4fd7-9420-d619004a4787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:15.785425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5cea3-bbbb-4fd7-9420-d619004a4787 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.785702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5cea3-bbbb-4fd7-9420-d619004a4787 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.785997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5cea3-bbbb-4fd7-9420-d619004a4787 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.793255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5cea3-bbbb-4fd7-9420-d619004a4787 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:15.794710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5cea3-bbbb-4fd7-9420-d619004a4787 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1fa5cea3-bbbb-4fd7-9420-d619004a4787 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:15.805996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:15.807111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:15.808007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:15.808007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:15.808007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:15.808007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:15.808007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:15.808007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:15.808007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:15.808007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:15.808007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 334/674] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:15.808007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5cea3-bbbb-4fd7-9420-d619004a4787 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.826553 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:15.856686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a63a6c-8c2c-48cc-9982-d9ee97fbc280 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:15.889642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411c47-2bfe-46fe-8b7a-dcebecc0ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:15.890283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411c47-2bfe-46fe-8b7a-dcebecc0ee70 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.890576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411c47-2bfe-46fe-8b7a-dcebecc0ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.890844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411c47-2bfe-46fe-8b7a-dcebecc0ee70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.897498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed411c47-2bfe-46fe-8b7a-dcebecc0ee70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:15.898923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed411c47-2bfe-46fe-8b7a-dcebecc0ee70 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:15.909414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5cea3-bbbb-4fd7-9420-d619004a4787 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ed411c47-2bfe-46fe-8b7a-dcebecc0ee70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:15.911226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:15.912162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:15.914260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:15.914260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:15.914260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:15.914260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:15.914260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:15.914260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:15.914260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:15.914260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:15.914260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 341/675] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:15.914260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411c47-2bfe-46fe-8b7a-dcebecc0ee70 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.945890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82150a9-7e3f-42ed-967f-c8b6bddfa007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:15.946505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82150a9-7e3f-42ed-967f-c8b6bddfa007 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.946787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82150a9-7e3f-42ed-967f-c8b6bddfa007 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.947290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82150a9-7e3f-42ed-967f-c8b6bddfa007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.947839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82150a9-7e3f-42ed-967f-c8b6bddfa007 None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=e8753f3c218248abbf8018056c67b923) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:15.948147 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82150a9-7e3f-42ed-967f-c8b6bddfa007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:15.949630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82150a9-7e3f-42ed-967f-c8b6bddfa007 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:15.965038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 335/676] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/role_assignments?user.id=e8753f3c218248abbf8018056c67b923&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:15.965038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f913c-897b-43ed-a38f-abd42f8d5806 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:15.965038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f913c-897b-43ed-a38f-abd42f8d5806 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:15.965038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f913c-897b-43ed-a38f-abd42f8d5806 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:15.965038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 336/677] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:15.965038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f913c-897b-43ed-a38f-abd42f8d5806 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:15.989159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:16.033334 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411c47-2bfe-46fe-8b7a-dcebecc0ee70 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:16.054522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:16.072764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64232f4-4a6f-4653-a6ae-5e472476518a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:16.073850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64232f4-4a6f-4653-a6ae-5e472476518a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:16.074132 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64232f4-4a6f-4653-a6ae-5e472476518a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:16.074416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64232f4-4a6f-4653-a6ae-5e472476518a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:16.081551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f913c-897b-43ed-a38f-abd42f8d5806 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:16.086878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64232f4-4a6f-4653-a6ae-5e472476518a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:16.088489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64232f4-4a6f-4653-a6ae-5e472476518a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e64232f4-4a6f-4653-a6ae-5e472476518a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:16.104643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:16.105883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:16.107583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:16.107583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:16.107583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:16.107583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:16.109936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 342/678] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:16.111240 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64232f4-4a6f-4653-a6ae-5e472476518a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:16.125327 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8ef04-1fad-47cb-b301-8d98245f8519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:16.125950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ef04-1fad-47cb-b301-8d98245f8519 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:16.126235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ef04-1fad-47cb-b301-8d98245f8519 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:16.126509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ef04-1fad-47cb-b301-8d98245f8519 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:16.127657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8ef04-1fad-47cb-b301-8d98245f8519 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:16.127657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8ef04-1fad-47cb-b301-8d98245f8519 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:16.129007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8ef04-1fad-47cb-b301-8d98245f8519 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:16.141656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 337/679] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:16.143102 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be8ac2-f876-4e5e-817a-e3862573ae2d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:16.143588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be8ac2-f876-4e5e-817a-e3862573ae2d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:16.143865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be8ac2-f876-4e5e-817a-e3862573ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:16.163360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-78be8ac2-f876-4e5e-817a-e3862573ae2d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:16.164641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-78be8ac2-f876-4e5e-817a-e3862573ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:16.231512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64232f4-4a6f-4653-a6ae-5e472476518a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:16.241723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 338/680] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:16.242751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be8ac2-f876-4e5e-817a-e3862573ae2d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:16.253005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:16.271829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f3bf2-f5b6-4853-a46b-9f65bc83cb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:16.273005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f3bf2-f5b6-4853-a46b-9f65bc83cb0a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:16.273005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f3bf2-f5b6-4853-a46b-9f65bc83cb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:16.273369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f3bf2-f5b6-4853-a46b-9f65bc83cb0a None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:16.274010 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f3bf2-f5b6-4853-a46b-9f65bc83cb0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:16.274320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f3bf2-f5b6-4853-a46b-9f65bc83cb0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:16.276329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f3bf2-f5b6-4853-a46b-9f65bc83cb0a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:16.288549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 343/681] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:16.289330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f3bf2-f5b6-4853-a46b-9f65bc83cb0a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:16.318190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:16.359579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be8ac2-f876-4e5e-817a-e3862573ae2d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:16.396787 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f3bf2-f5b6-4853-a46b-9f65bc83cb0a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:16.396985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2acee1-79ed-4056-8a6e-6d3c01e07125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:16.397477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2acee1-79ed-4056-8a6e-6d3c01e07125 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:16.397761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2acee1-79ed-4056-8a6e-6d3c01e07125 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:16.398032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2acee1-79ed-4056-8a6e-6d3c01e07125 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:16.398730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2acee1-79ed-4056-8a6e-6d3c01e07125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:16.399035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2acee1-79ed-4056-8a6e-6d3c01e07125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:16.400546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2acee1-79ed-4056-8a6e-6d3c01e07125 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:16.416089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 339/682] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:16.416089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2acee1-79ed-4056-8a6e-6d3c01e07125 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:16.440097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd4fc-a4aa-45c2-9aaf-86c586b25fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:16.441047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd4fc-a4aa-45c2-9aaf-86c586b25fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:16.441367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd4fc-a4aa-45c2-9aaf-86c586b25fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:16.441790 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd4fc-a4aa-45c2-9aaf-86c586b25fa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:16.442597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd4fc-a4aa-45c2-9aaf-86c586b25fa5 None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=ce47f69d77124bdbbde63374b270b6fb) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:16.442916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd4fc-a4aa-45c2-9aaf-86c586b25fa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:16.444341 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd4fc-a4aa-45c2-9aaf-86c586b25fa5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:16.461161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 344/683] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:16 2022] GET /identity/v3/role_assignments?user.id=ce47f69d77124bdbbde63374b270b6fb&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:16.461161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd4fc-a4aa-45c2-9aaf-86c586b25fa5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:16.516141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:16.542409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2acee1-79ed-4056-8a6e-6d3c01e07125 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:16.579086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:16.588347 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43caa6-289a-4bb7-8f9e-617873b653f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:16.591449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43caa6-289a-4bb7-8f9e-617873b653f2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:16.591449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43caa6-289a-4bb7-8f9e-617873b653f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:16.591449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43caa6-289a-4bb7-8f9e-617873b653f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:16.602224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43caa6-289a-4bb7-8f9e-617873b653f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:16.605591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd4fc-a4aa-45c2-9aaf-86c586b25fa5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ec43caa6-289a-4bb7-8f9e-617873b653f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:16.607977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:16.609100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:16.609988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:16.612633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 340/684] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:16.613990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43caa6-289a-4bb7-8f9e-617873b653f2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:16.651216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd9b03-1e12-41b6-8d85-d4fdf9e69255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:16.652212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9b03-1e12-41b6-8d85-d4fdf9e69255 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:16.652500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9b03-1e12-41b6-8d85-d4fdf9e69255 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:16.652779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9b03-1e12-41b6-8d85-d4fdf9e69255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:16.654524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd9b03-1e12-41b6-8d85-d4fdf9e69255 None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=76596e04e82b43cb8b68ee2f5e6dd9e2) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:16.654524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd9b03-1e12-41b6-8d85-d4fdf9e69255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:16.655745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd9b03-1e12-41b6-8d85-d4fdf9e69255 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:16.662803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 345/685] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:16 2022] GET /identity/v3/role_assignments?user.id=76596e04e82b43cb8b68ee2f5e6dd9e2&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:16.663638 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd9b03-1e12-41b6-8d85-d4fdf9e69255 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:16.769650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43caa6-289a-4bb7-8f9e-617873b653f2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:16.813612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9701-4787-4f21-80a5-38cbfff1c970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:16.814268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9701-4787-4f21-80a5-38cbfff1c970 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:16.814544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9701-4787-4f21-80a5-38cbfff1c970 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:16.815265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9701-4787-4f21-80a5-38cbfff1c970 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:16.824432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec9701-4787-4f21-80a5-38cbfff1c970 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:16.825738 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec9701-4787-4f21-80a5-38cbfff1c970 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:16.832080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd9b03-1e12-41b6-8d85-d4fdf9e69255 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fcec9701-4787-4f21-80a5-38cbfff1c970 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:16.838782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:16.839788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:16.840753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:16.840753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:16.840753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:16.840753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:16.840753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:16.840753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:16.840753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:16.840753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:16.840753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:16.840753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:16.844466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 341/686] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:16.845000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:16.846260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9701-4787-4f21-80a5-38cbfff1c970 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:16.883294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71b4e-7c9b-47b3-8ce2-396e1d95d2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:16.884274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71b4e-7c9b-47b3-8ce2-396e1d95d2be None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:16.884751 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71b4e-7c9b-47b3-8ce2-396e1d95d2be None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:16.885236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71b4e-7c9b-47b3-8ce2-396e1d95d2be None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:16.887648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71b4e-7c9b-47b3-8ce2-396e1d95d2be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:16.888295 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71b4e-7c9b-47b3-8ce2-396e1d95d2be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:16.890048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71b4e-7c9b-47b3-8ce2-396e1d95d2be None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:16.901122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 346/687] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:20:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:16.906802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71b4e-7c9b-47b3-8ce2-396e1d95d2be None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:16.909215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:16.968156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9701-4787-4f21-80a5-38cbfff1c970 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:17.004754 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ac73e-09b5-4ff7-8bbd-84c27765eb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:17.005481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ac73e-09b5-4ff7-8bbd-84c27765eb9d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:17.005828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ac73e-09b5-4ff7-8bbd-84c27765eb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:17.006166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ac73e-09b5-4ff7-8bbd-84c27765eb9d None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:17.007234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ac73e-09b5-4ff7-8bbd-84c27765eb9d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:17.007349 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ac73e-09b5-4ff7-8bbd-84c27765eb9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:17.008866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ac73e-09b5-4ff7-8bbd-84c27765eb9d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:17.020444 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71b4e-7c9b-47b3-8ce2-396e1d95d2be None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:17.032171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 342/688] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 05:20:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:17.033475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ac73e-09b5-4ff7-8bbd-84c27765eb9d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:17.059007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6c616-e7be-4dfb-8a8c-a3a93b6a9c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:17.060057 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6c616-e7be-4dfb-8a8c-a3a93b6a9c9e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:17.060540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6c616-e7be-4dfb-8a8c-a3a93b6a9c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:17.061026 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6c616-e7be-4dfb-8a8c-a3a93b6a9c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:17.073466 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6c616-e7be-4dfb-8a8c-a3a93b6a9c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:17.075671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6c616-e7be-4dfb-8a8c-a3a93b6a9c9e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-17f6c616-e7be-4dfb-8a8c-a3a93b6a9c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:17.091678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:17.092624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:17.093542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:17.093542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:17.093542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:17.093542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:17.095895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 347/689] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:17.101598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6c616-e7be-4dfb-8a8c-a3a93b6a9c9e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:17.127525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:17.140439 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ac73e-09b5-4ff7-8bbd-84c27765eb9d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:17.142969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:17.178594 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61114cdc-9d5d-4bc8-a04b-0924b94fd781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:17.179361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114cdc-9d5d-4bc8-a04b-0924b94fd781 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:17.179639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114cdc-9d5d-4bc8-a04b-0924b94fd781 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:17.179908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114cdc-9d5d-4bc8-a04b-0924b94fd781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:17.220902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6c616-e7be-4dfb-8a8c-a3a93b6a9c9e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:17.255096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61114cdc-9d5d-4bc8-a04b-0924b94fd781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:17.256558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61114cdc-9d5d-4bc8-a04b-0924b94fd781 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:17.259445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d5ce-cbac-46b0-b4ea-5844880541c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:17.260348 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d5ce-cbac-46b0-b4ea-5844880541c6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:17.260887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d5ce-cbac-46b0-b4ea-5844880541c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:17.261463 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d5ce-cbac-46b0-b4ea-5844880541c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:17.262577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d5ce-cbac-46b0-b4ea-5844880541c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:17.263106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d5ce-cbac-46b0-b4ea-5844880541c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:17.264681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d5ce-cbac-46b0-b4ea-5844880541c6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:17.278255 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 348/690] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:17.283910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d5ce-cbac-46b0-b4ea-5844880541c6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:17.365336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 343/691] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:20:17.366666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61114cdc-9d5d-4bc8-a04b-0924b94fd781 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:17.369710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:17.375254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:17.395637 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d5ce-cbac-46b0-b4ea-5844880541c6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:17.432884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d86238-19b5-438b-a02c-cbe0e1ea95f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:17.433926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d86238-19b5-438b-a02c-cbe0e1ea95f1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:17.434408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d86238-19b5-438b-a02c-cbe0e1ea95f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:17.434894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d86238-19b5-438b-a02c-cbe0e1ea95f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:17.442573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d86238-19b5-438b-a02c-cbe0e1ea95f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:17.444319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d86238-19b5-438b-a02c-cbe0e1ea95f1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e4d86238-19b5-438b-a02c-cbe0e1ea95f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:17.456508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:17.465350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:17.466318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:17.466318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:17.466318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:17.466318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:17.466318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:17.466318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:17.466318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:17.466318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:17.466318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:17.466318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:17.466318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 349/692] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 05:20:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:17.467604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d86238-19b5-438b-a02c-cbe0e1ea95f1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:17.472365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61114cdc-9d5d-4bc8-a04b-0924b94fd781 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:17.511661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006b18a-8fa5-4303-b539-06e0edc9dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:17.512561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006b18a-8fa5-4303-b539-06e0edc9dccf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:17.512677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006b18a-8fa5-4303-b539-06e0edc9dccf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:17.512930 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006b18a-8fa5-4303-b539-06e0edc9dccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:17.524371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006b18a-8fa5-4303-b539-06e0edc9dccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:17.526560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006b18a-8fa5-4303-b539-06e0edc9dccf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0006b18a-8fa5-4303-b539-06e0edc9dccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:17.542658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:17.543608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:17.544516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:17.544516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:17.544516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:17.544516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:17.549046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 344/693] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:17.549541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006b18a-8fa5-4303-b539-06e0edc9dccf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:17.582228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d86238-19b5-438b-a02c-cbe0e1ea95f1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:17.609456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:17.625397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad1640-67eb-46cc-aaf3-162786c95231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:17.625397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad1640-67eb-46cc-aaf3-162786c95231 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:17.625397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad1640-67eb-46cc-aaf3-162786c95231 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:17.625397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad1640-67eb-46cc-aaf3-162786c95231 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:17.625862 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad1640-67eb-46cc-aaf3-162786c95231 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:17.625862 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad1640-67eb-46cc-aaf3-162786c95231 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:17.625862 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad1640-67eb-46cc-aaf3-162786c95231 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:17.633964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:17.652259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 350/694] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 05:20:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:17.657376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006b18a-8fa5-4303-b539-06e0edc9dccf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:17.657602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad1640-67eb-46cc-aaf3-162786c95231 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:17.693907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67070c-9842-477d-bc46-33f06eb90b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:17.694430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67070c-9842-477d-bc46-33f06eb90b0e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:17.694783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67070c-9842-477d-bc46-33f06eb90b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:17.695128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67070c-9842-477d-bc46-33f06eb90b0e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:17.695918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67070c-9842-477d-bc46-33f06eb90b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:17.696287 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67070c-9842-477d-bc46-33f06eb90b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:17.698401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67070c-9842-477d-bc46-33f06eb90b0e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:17.715385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 345/695] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:17.718698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67070c-9842-477d-bc46-33f06eb90b0e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:17.791077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad1640-67eb-46cc-aaf3-162786c95231 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:17.829666 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71776a8-5e74-417e-a758-f7195e377b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:17.831001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71776a8-5e74-417e-a758-f7195e377b77 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:17.831494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71776a8-5e74-417e-a758-f7195e377b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:17.831990 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71776a8-5e74-417e-a758-f7195e377b77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:17.906212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:17.910669 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71776a8-5e74-417e-a758-f7195e377b77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:17.912379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71776a8-5e74-417e-a758-f7195e377b77 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:18.025724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 351/696] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 05:20:18.033360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71776a8-5e74-417e-a758-f7195e377b77 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:18.047436 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67070c-9842-477d-bc46-33f06eb90b0e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:18.095085 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:18.138370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:18.142297 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71776a8-5e74-417e-a758-f7195e377b77 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:18.145830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5099b12-52bf-45d6-ac54-a9b7cb0f691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:18.146493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5099b12-52bf-45d6-ac54-a9b7cb0f691c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:18.146771 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5099b12-52bf-45d6-ac54-a9b7cb0f691c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:18.147040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5099b12-52bf-45d6-ac54-a9b7cb0f691c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:18.162364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5099b12-52bf-45d6-ac54-a9b7cb0f691c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:18.163766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5099b12-52bf-45d6-ac54-a9b7cb0f691c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:18.183419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cecc6-217b-4b8a-9d8b-58be062211ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:18.184069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cecc6-217b-4b8a-9d8b-58be062211ba None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:18.184346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cecc6-217b-4b8a-9d8b-58be062211ba None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:18.184617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cecc6-217b-4b8a-9d8b-58be062211ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d5099b12-52bf-45d6-ac54-a9b7cb0f691c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:18.187234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:18.188155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:18.189437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:18.189437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:18.189437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:18.189437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:18.189437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:18.189437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:18.189437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:18.189437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:18.189437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 346/697] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 470 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:18.195624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5099b12-52bf-45d6-ac54-a9b7cb0f691c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:18.214261 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cecc6-217b-4b8a-9d8b-58be062211ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:18.215743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cecc6-217b-4b8a-9d8b-58be062211ba None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fe7cecc6-217b-4b8a-9d8b-58be062211ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:18.234489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:18.235469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:18.236980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:18.236980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:18.236980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:18.236980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:18.236980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 352/698] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:18.237321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9e28-40b8-49c8-8ed9-8980c59fc658 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:18.237557 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9e28-40b8-49c8-8ed9-8980c59fc658 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:18.237747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9e28-40b8-49c8-8ed9-8980c59fc658 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:18.242870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 353/699] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:18.243655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9e28-40b8-49c8-8ed9-8980c59fc658 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:18.312326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5099b12-52bf-45d6-ac54-a9b7cb0f691c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:18.346613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9e28-40b8-49c8-8ed9-8980c59fc658 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:18.349034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965b468-5734-4d03-ad61-d7f6c846e383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:18.349693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965b468-5734-4d03-ad61-d7f6c846e383 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:18.349975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965b468-5734-4d03-ad61-d7f6c846e383 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:18.350249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965b468-5734-4d03-ad61-d7f6c846e383 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:18.351001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965b468-5734-4d03-ad61-d7f6c846e383 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:18.351308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965b468-5734-4d03-ad61-d7f6c846e383 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:18.352812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965b468-5734-4d03-ad61-d7f6c846e383 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:18.366088 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 347/700] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:18.367752 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca059db-df30-4d70-a595-05bbebcb1922 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:18.368156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca059db-df30-4d70-a595-05bbebcb1922 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:18.368532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca059db-df30-4d70-a595-05bbebcb1922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:18.380779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc889e5-c85c-4c7f-8f3f-6ca5f9332c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:18.381473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc889e5-c85c-4c7f-8f3f-6ca5f9332c97 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:18.381753 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc889e5-c85c-4c7f-8f3f-6ca5f9332c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:18.382023 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc889e5-c85c-4c7f-8f3f-6ca5f9332c97 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:18.382717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc889e5-c85c-4c7f-8f3f-6ca5f9332c97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:18.383015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc889e5-c85c-4c7f-8f3f-6ca5f9332c97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:18.384905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc889e5-c85c-4c7f-8f3f-6ca5f9332c97 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:18.388951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9ca059db-df30-4d70-a595-05bbebcb1922 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:18.390344 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9ca059db-df30-4d70-a595-05bbebcb1922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:18.397089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 354/701] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:18.397936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc889e5-c85c-4c7f-8f3f-6ca5f9332c97 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:18.410832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:18.428382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:18.467926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 348/702] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:18.469262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca059db-df30-4d70-a595-05bbebcb1922 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:18.525036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc889e5-c85c-4c7f-8f3f-6ca5f9332c97 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:18.560769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa7ea6-f901-4a58-956c-8e9393549a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:18.561424 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa7ea6-f901-4a58-956c-8e9393549a70 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:18.561705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa7ea6-f901-4a58-956c-8e9393549a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:18.561978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa7ea6-f901-4a58-956c-8e9393549a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:18.562765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa7ea6-f901-4a58-956c-8e9393549a70 None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=ef24fa7356ac455b8994e0e6d1959654) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:18.563073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa7ea6-f901-4a58-956c-8e9393549a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:18.564519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa7ea6-f901-4a58-956c-8e9393549a70 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:18.571086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 355/703] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:18 2022] GET /identity/v3/role_assignments?user.id=ef24fa7356ac455b8994e0e6d1959654&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:18.571743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa7ea6-f901-4a58-956c-8e9393549a70 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:18.581300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca059db-df30-4d70-a595-05bbebcb1922 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:18.634827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a53d7-6e91-48df-a599-f3ede20f9617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:18.635945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a53d7-6e91-48df-a599-f3ede20f9617 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:18.637508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a53d7-6e91-48df-a599-f3ede20f9617 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:18.638036 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a53d7-6e91-48df-a599-f3ede20f9617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:18.652448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a53d7-6e91-48df-a599-f3ede20f9617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:18.655240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a53d7-6e91-48df-a599-f3ede20f9617 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-872a53d7-6e91-48df-a599-f3ede20f9617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:18.681707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:18.682663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:18.683581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:18.683581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:18.683581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:18.683581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:18.683581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:18.683581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:18.683581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:18.683581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:18.687731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 349/704] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:18.694138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a53d7-6e91-48df-a599-f3ede20f9617 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:18.720565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:18.751620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:18.764227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa7ea6-f901-4a58-956c-8e9393549a70 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:18.804298 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fc2ba-4b97-4595-a626-a140482b5ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:18.805359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fc2ba-4b97-4595-a626-a140482b5ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:18.805847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fc2ba-4b97-4595-a626-a140482b5ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:18.806389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fc2ba-4b97-4595-a626-a140482b5ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:18.826879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fc2ba-4b97-4595-a626-a140482b5ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:18.828850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fc2ba-4b97-4595-a626-a140482b5ca5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0a7fc2ba-4b97-4595-a626-a140482b5ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:18.848489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:18.849495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:18.850400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:18.850400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:18.850400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:18.850400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:18.850400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 356/705] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:18.852168 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a53d7-6e91-48df-a599-f3ede20f9617 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:18.857231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fc2ba-4b97-4595-a626-a140482b5ca5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:18.901269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed588356-5f24-496d-b110-9387aba63407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:18.901897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed588356-5f24-496d-b110-9387aba63407 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:18.902175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed588356-5f24-496d-b110-9387aba63407 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:18.902443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed588356-5f24-496d-b110-9387aba63407 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:18.903521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed588356-5f24-496d-b110-9387aba63407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:18.903959 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed588356-5f24-496d-b110-9387aba63407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:18.905583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed588356-5f24-496d-b110-9387aba63407 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:18.921171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 350/706] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:18.926923 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed588356-5f24-496d-b110-9387aba63407 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:18.999543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fc2ba-4b97-4595-a626-a140482b5ca5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:19.035097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:19.036720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:19.047625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e58019-7656-464c-b4cc-8873d9fcc0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:19.048254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58019-7656-464c-b4cc-8873d9fcc0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:19.058712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58019-7656-464c-b4cc-8873d9fcc0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:19.058712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58019-7656-464c-b4cc-8873d9fcc0d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:19.058712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e58019-7656-464c-b4cc-8873d9fcc0d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:19.058712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e58019-7656-464c-b4cc-8873d9fcc0d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:19.058712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e58019-7656-464c-b4cc-8873d9fcc0d3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:19.059075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed588356-5f24-496d-b110-9387aba63407 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:19.067203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 357/707] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:19.069164 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991f0f3-3a5c-4ad3-8e5e-e0ed04472fa6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:19.069739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991f0f3-3a5c-4ad3-8e5e-e0ed04472fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:19.070019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991f0f3-3a5c-4ad3-8e5e-e0ed04472fa6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:19.072624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 358/708] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:19.078073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991f0f3-3a5c-4ad3-8e5e-e0ed04472fa6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:19.091297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b0b3-8c0c-4db6-98d3-72846aa8ae7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:19.091980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b0b3-8c0c-4db6-98d3-72846aa8ae7b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:19.092571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b0b3-8c0c-4db6-98d3-72846aa8ae7b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:19.092846 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b0b3-8c0c-4db6-98d3-72846aa8ae7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:19.094020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2b0b3-8c0c-4db6-98d3-72846aa8ae7b None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=531ebc9dee0440888b94a6bf17d7a335) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:19.094334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2b0b3-8c0c-4db6-98d3-72846aa8ae7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:19.096358 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2b0b3-8c0c-4db6-98d3-72846aa8ae7b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:19.104345 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 351/709] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:18 2022] GET /identity/v3/role_assignments?user.id=531ebc9dee0440888b94a6bf17d7a335&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=57a86ff4c9de433399662eebf6893065 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:19.105610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adefc3a-c96e-41cb-b478-56b2590f609a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:19.105896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adefc3a-c96e-41cb-b478-56b2590f609a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:19.106179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adefc3a-c96e-41cb-b478-56b2590f609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:19.128229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5adefc3a-c96e-41cb-b478-56b2590f609a None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:19.129754 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5adefc3a-c96e-41cb-b478-56b2590f609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:19.252201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 352/710] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:19.283098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991f0f3-3a5c-4ad3-8e5e-e0ed04472fa6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:19.297946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adefc3a-c96e-41cb-b478-56b2590f609a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:19.331106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78bdf3-eb03-46d3-9244-5532143a4930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:19.331779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78bdf3-eb03-46d3-9244-5532143a4930 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:19.332058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78bdf3-eb03-46d3-9244-5532143a4930 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:19.332326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78bdf3-eb03-46d3-9244-5532143a4930 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:19.332997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78bdf3-eb03-46d3-9244-5532143a4930 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:19.334484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78bdf3-eb03-46d3-9244-5532143a4930 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:19.409560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:19.419364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 359/711] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:20:19 2022] POST /identity/v3/users => generated 254 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:19.445000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adefc3a-c96e-41cb-b478-56b2590f609a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:19.491256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6e8e8-ec20-4f44-a189-a6bb20441732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:19.491922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e8e8-ec20-4f44-a189-a6bb20441732 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:19.492198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e8e8-ec20-4f44-a189-a6bb20441732 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:19.492464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e8e8-ec20-4f44-a189-a6bb20441732 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:19.493101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6e8e8-ec20-4f44-a189-a6bb20441732 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:19.495101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6e8e8-ec20-4f44-a189-a6bb20441732 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-54e6e8e8-ec20-4f44-a189-a6bb20441732 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:19.506915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:19.507999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:20:19.508871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:19.513348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 353/712] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 05:20:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:19.515298 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78bdf3-eb03-46d3-9244-5532143a4930 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:19.581178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:19.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76412217-c474-4587-8f4f-a7d4d305c0f0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:19.622447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76412217-c474-4587-8f4f-a7d4d305c0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:19.622671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76412217-c474-4587-8f4f-a7d4d305c0f0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:19.624162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 354/713] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:19.628987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa60b3-8f22-4a81-93e8-7f4794fb7913 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:19.629332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa60b3-8f22-4a81-93e8-7f4794fb7913 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:19.629606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa60b3-8f22-4a81-93e8-7f4794fb7913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:19.651023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-97fa60b3-8f22-4a81-93e8-7f4794fb7913 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:19.652223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-97fa60b3-8f22-4a81-93e8-7f4794fb7913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:19.660857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78bdf3-eb03-46d3-9244-5532143a4930 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:19.704570 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2842056-6efa-41e4-9481-477fe2670308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:19.705607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2842056-6efa-41e4-9481-477fe2670308 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:19.706040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2842056-6efa-41e4-9481-477fe2670308 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:19.706436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2842056-6efa-41e4-9481-477fe2670308 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:19.707133 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2842056-6efa-41e4-9481-477fe2670308 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:19.707441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2842056-6efa-41e4-9481-477fe2670308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:19.709290 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2842056-6efa-41e4-9481-477fe2670308 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:19.715913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 360/714] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 05:20:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:19.722870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2842056-6efa-41e4-9481-477fe2670308 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:19.731860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 355/715] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 05:20:19.766810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa60b3-8f22-4a81-93e8-7f4794fb7913 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:19.855001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2842056-6efa-41e4-9481-477fe2670308 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:19.862326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:19.864186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:19.884601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa60b3-8f22-4a81-93e8-7f4794fb7913 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:19.900337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb192985-0f58-40c8-8fcb-8b1f2516ff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:19.900986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192985-0f58-40c8-8fcb-8b1f2516ff5d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:19.901307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192985-0f58-40c8-8fcb-8b1f2516ff5d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:19.901583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb192985-0f58-40c8-8fcb-8b1f2516ff5d None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:19.902267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb192985-0f58-40c8-8fcb-8b1f2516ff5d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:19.902571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb192985-0f58-40c8-8fcb-8b1f2516ff5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:19.903948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb192985-0f58-40c8-8fcb-8b1f2516ff5d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:19.910650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 361/716] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 05:20:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:19.958964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4fef4-7e38-4898-9036-3fe99d538d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:19.959925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fef4-7e38-4898-9036-3fe99d538d44 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:19.960352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fef4-7e38-4898-9036-3fe99d538d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:19.960777 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fef4-7e38-4898-9036-3fe99d538d44 None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:19.961615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4fef4-7e38-4898-9036-3fe99d538d44 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:19.964604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4fef4-7e38-4898-9036-3fe99d538d44 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b7f4fef4-7e38-4898-9036-3fe99d538d44 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:19.982134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:19.983235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:20:19.984072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:19.988260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 356/717] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:19 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:19.989768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb192985-0f58-40c8-8fcb-8b1f2516ff5d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:20.139573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb192985-0f58-40c8-8fcb-8b1f2516ff5d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:20.193327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e83ebb-50d0-4fe5-bdf7-6d4b3882fd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:20.193968 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83ebb-50d0-4fe5-bdf7-6d4b3882fd75 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:20.194249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83ebb-50d0-4fe5-bdf7-6d4b3882fd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:20.194522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83ebb-50d0-4fe5-bdf7-6d4b3882fd75 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:20.195212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e83ebb-50d0-4fe5-bdf7-6d4b3882fd75 None admin] RBAC: Adding query filter params (name=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:20.195518 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e83ebb-50d0-4fe5-bdf7-6d4b3882fd75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:20.196935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e83ebb-50d0-4fe5-bdf7-6d4b3882fd75 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:20.203468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 362/718] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:20.210232 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4fef4-7e38-4898-9036-3fe99d538d44 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:20.336884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4fef4-7e38-4898-9036-3fe99d538d44 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:20.380700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328e91-0235-45f6-ba60-182dbaec572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:20.381346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328e91-0235-45f6-ba60-182dbaec572d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:20.381626 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328e91-0235-45f6-ba60-182dbaec572d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:20.381902 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328e91-0235-45f6-ba60-182dbaec572d None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:20.382588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e328e91-0235-45f6-ba60-182dbaec572d None admin] RBAC: Adding query filter params (type=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:20.382898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e328e91-0235-45f6-ba60-182dbaec572d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:20.384300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e328e91-0235-45f6-ba60-182dbaec572d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:20.390613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 357/719] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:21.238421 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55408553-c1bd-4d0a-8fde-8df94d7376c8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:21.238930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55408553-c1bd-4d0a-8fde-8df94d7376c8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:21.239040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55408553-c1bd-4d0a-8fde-8df94d7376c8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:21.240639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 363/720] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:21.258933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8189-2338-4f1c-99c7-6808363b08c3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:21.259583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8189-2338-4f1c-99c7-6808363b08c3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:21.259583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8189-2338-4f1c-99c7-6808363b08c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:21.266911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:21.285340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-54ad8189-2338-4f1c-99c7-6808363b08c3 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:21.286540 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-54ad8189-2338-4f1c-99c7-6808363b08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:21.398855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 358/721] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:21.437570 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55408553-c1bd-4d0a-8fde-8df94d7376c8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:21.490757 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:21.540954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b3144-7a68-4605-aac7-1f8796199689 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:21.541306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b3144-7a68-4605-aac7-1f8796199689 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:21.541556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b3144-7a68-4605-aac7-1f8796199689 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:21.543171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 359/722] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:21.547968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3e3a3-12fb-42c6-92a0-ad8b8234b322 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:21.548257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3e3a3-12fb-42c6-92a0-ad8b8234b322 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:21.548528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3e3a3-12fb-42c6-92a0-ad8b8234b322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:21.581952 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cbe3e3a3-12fb-42c6-92a0-ad8b8234b322 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:21.583133 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cbe3e3a3-12fb-42c6-92a0-ad8b8234b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:21.670292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55408553-c1bd-4d0a-8fde-8df94d7376c8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:21.702350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 360/723] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:21.731825 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3e3a3-12fb-42c6-92a0-ad8b8234b322 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:21.746948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b887399-26f6-4244-88ef-2d6667aa3ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:21.748019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887399-26f6-4244-88ef-2d6667aa3ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:21.749832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887399-26f6-4244-88ef-2d6667aa3ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:21.750547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887399-26f6-4244-88ef-2d6667aa3ac4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:21.775965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b887399-26f6-4244-88ef-2d6667aa3ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8b887399-26f6-4244-88ef-2d6667aa3ac4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:21.781649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:21.782598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:21.783469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:21.790076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 364/724] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:21.793032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b887399-26f6-4244-88ef-2d6667aa3ac4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:21.898708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:21.953978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:21.964962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b887399-26f6-4244-88ef-2d6667aa3ac4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:21.973783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3e3a3-12fb-42c6-92a0-ad8b8234b322 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:22.036443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f246de-0e22-4df7-af65-c81ab65b4115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:22.037078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f246de-0e22-4df7-af65-c81ab65b4115 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.037381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f246de-0e22-4df7-af65-c81ab65b4115 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.037656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f246de-0e22-4df7-af65-c81ab65b4115 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.038372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f246de-0e22-4df7-af65-c81ab65b4115 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:22.038674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f246de-0e22-4df7-af65-c81ab65b4115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:22.040034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f246de-0e22-4df7-af65-c81ab65b4115 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:22.041719 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea17618-d269-4021-9c55-04c2cb13776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:22.042814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea17618-d269-4021-9c55-04c2cb13776a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.043288 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea17618-d269-4021-9c55-04c2cb13776a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.043764 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea17618-d269-4021-9c55-04c2cb13776a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.057492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 365/725] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:20:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:22.065912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f246de-0e22-4df7-af65-c81ab65b4115 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:22.067253 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea17618-d269-4021-9c55-04c2cb13776a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0ea17618-d269-4021-9c55-04c2cb13776a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:22.072184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:22.073231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:22.078943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 361/726] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:22.080824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea17618-d269-4021-9c55-04c2cb13776a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:22.197916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea17618-d269-4021-9c55-04c2cb13776a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:22.246057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:22.270511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708b6c6-0d97-4f46-8391-6dce5e4dba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:22.271953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708b6c6-0d97-4f46-8391-6dce5e4dba6e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.272454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708b6c6-0d97-4f46-8391-6dce5e4dba6e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.272960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708b6c6-0d97-4f46-8391-6dce5e4dba6e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.273905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708b6c6-0d97-4f46-8391-6dce5e4dba6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:22.274415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708b6c6-0d97-4f46-8391-6dce5e4dba6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:22.276580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708b6c6-0d97-4f46-8391-6dce5e4dba6e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:22.293295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 362/727] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:20:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:22.295113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcb534-6bf8-4033-8a6a-fe20b665dd36 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.295399 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcb534-6bf8-4033-8a6a-fe20b665dd36 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.295679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcb534-6bf8-4033-8a6a-fe20b665dd36 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.297105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 363/728] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:22.300932 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcb534-6bf8-4033-8a6a-fe20b665dd36 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:22.316475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f246de-0e22-4df7-af65-c81ab65b4115 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:22.360933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854a54a-8eda-418c-bb80-2db85f390800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:22.362239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854a54a-8eda-418c-bb80-2db85f390800 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.362794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854a54a-8eda-418c-bb80-2db85f390800 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.363432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854a54a-8eda-418c-bb80-2db85f390800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.377807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854a54a-8eda-418c-bb80-2db85f390800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:22.380517 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854a54a-8eda-418c-bb80-2db85f390800 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3854a54a-8eda-418c-bb80-2db85f390800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:22.398663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:22.400204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:22.401180 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:22.401180 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:22.401180 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:22.401180 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:22.407108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 366/729] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:22.407108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770999f-4e15-42ef-a9c0-4e3300027bd3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.407108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770999f-4e15-42ef-a9c0-4e3300027bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.407108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770999f-4e15-42ef-a9c0-4e3300027bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.424849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcb534-6bf8-4033-8a6a-fe20b665dd36 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:22.427126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5770999f-4e15-42ef-a9c0-4e3300027bd3 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:22.428778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5770999f-4e15-42ef-a9c0-4e3300027bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:22.430468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:22.470150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf4394-ed6c-4676-9e2d-6ecb43811cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:22.471204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4394-ed6c-4676-9e2d-6ecb43811cbc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.472178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4394-ed6c-4676-9e2d-6ecb43811cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.472670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf4394-ed6c-4676-9e2d-6ecb43811cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.488915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf4394-ed6c-4676-9e2d-6ecb43811cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:22.491363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf4394-ed6c-4676-9e2d-6ecb43811cbc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:22.509227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 367/730] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:22.509227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770999f-4e15-42ef-a9c0-4e3300027bd3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d7bf4394-ed6c-4676-9e2d-6ecb43811cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:22.516746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:22.517684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:22.518578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:22.518578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:22.518578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:22.518578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:22.526888 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 364/731] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:22.532531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf4394-ed6c-4676-9e2d-6ecb43811cbc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:22.571065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:22.619566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770999f-4e15-42ef-a9c0-4e3300027bd3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:22.640676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf4394-ed6c-4676-9e2d-6ecb43811cbc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:22.655424 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7816a2-10d5-4e7c-bc26-94bb8f821320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:22.656046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7816a2-10d5-4e7c-bc26-94bb8f821320 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.656324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7816a2-10d5-4e7c-bc26-94bb8f821320 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.656598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7816a2-10d5-4e7c-bc26-94bb8f821320 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.657315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7816a2-10d5-4e7c-bc26-94bb8f821320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:22.657616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7816a2-10d5-4e7c-bc26-94bb8f821320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:22.658969 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7816a2-10d5-4e7c-bc26-94bb8f821320 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:22.666492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:22.675816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 368/732] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:22.675816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66f333-f2db-4650-a24c-d80e10a85ca0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.675816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66f333-f2db-4650-a24c-d80e10a85ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.675816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66f333-f2db-4650-a24c-d80e10a85ca0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.678916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 369/733] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:22.678916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66f333-f2db-4650-a24c-d80e10a85ca0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:22.682569 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4ee47-fcc1-4b20-a712-a0828eeb61be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:22.683812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4ee47-fcc1-4b20-a712-a0828eeb61be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.683812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4ee47-fcc1-4b20-a712-a0828eeb61be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.683812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4ee47-fcc1-4b20-a712-a0828eeb61be None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.684402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4ee47-fcc1-4b20-a712-a0828eeb61be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:22.684705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4ee47-fcc1-4b20-a712-a0828eeb61be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:22.686110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4ee47-fcc1-4b20-a712-a0828eeb61be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:22.699104 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 365/734] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:22.699981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4ee47-fcc1-4b20-a712-a0828eeb61be None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:22.792291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66f333-f2db-4650-a24c-d80e10a85ca0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:22.796443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:22.802358 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4ee47-fcc1-4b20-a712-a0828eeb61be None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:22.827419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ebaf8-780b-427b-b71b-f1516e64b552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:22.828112 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ebaf8-780b-427b-b71b-f1516e64b552 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.828473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ebaf8-780b-427b-b71b-f1516e64b552 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.828762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ebaf8-780b-427b-b71b-f1516e64b552 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.836054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48406b4-4853-4a0f-9863-4182cc47a8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:22.836683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48406b4-4853-4a0f-9863-4182cc47a8be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.836962 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48406b4-4853-4a0f-9863-4182cc47a8be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.837870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48406b4-4853-4a0f-9863-4182cc47a8be None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.839066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ebaf8-780b-427b-b71b-f1516e64b552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6c5ebaf8-780b-427b-b71b-f1516e64b552 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:22.844342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:22.845457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:22.846332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:22.847060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48406b4-4853-4a0f-9863-4182cc47a8be None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:22.847132 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 370/735] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:22.847201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48406b4-4853-4a0f-9863-4182cc47a8be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:22.847269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba341a-24e9-47fa-aedc-f438eca6a878 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.847269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba341a-24e9-47fa-aedc-f438eca6a878 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.847269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba341a-24e9-47fa-aedc-f438eca6a878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f48406b4-4853-4a0f-9863-4182cc47a8be None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:22.862197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:22.863255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 366/736] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:22.864197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48406b4-4853-4a0f-9863-4182cc47a8be None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:22.869588 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1aba341a-24e9-47fa-aedc-f438eca6a878 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:22.870730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1aba341a-24e9-47fa-aedc-f438eca6a878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:22.922163 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:22.937565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 371/737] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:22.938316 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f337c-198a-4a22-bc26-07e598d9a953 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:22.938602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f337c-198a-4a22-bc26-07e598d9a953 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:22.938873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f337c-198a-4a22-bc26-07e598d9a953 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:22.941167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 372/738] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:22.941167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f337c-198a-4a22-bc26-07e598d9a953 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:22.971190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48406b4-4853-4a0f-9863-4182cc47a8be None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:23.004844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a75e-ef8c-450b-a152-4b6b3f682a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:23.005498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a75e-ef8c-450b-a152-4b6b3f682a3e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:23.005777 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a75e-ef8c-450b-a152-4b6b3f682a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:23.006042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a75e-ef8c-450b-a152-4b6b3f682a3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:23.014136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a75e-ef8c-450b-a152-4b6b3f682a3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:23.015588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a75e-ef8c-450b-a152-4b6b3f682a3e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-74e0a75e-ef8c-450b-a152-4b6b3f682a3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:23.026440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:23.027460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:23.028416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:23.028416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:23.028416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:23.028416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:23.028416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:23.028416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:23.028416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:23.028416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:23.028416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:23.028416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:23.028416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 367/739] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 05:20:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:23.029007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a75e-ef8c-450b-a152-4b6b3f682a3e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:23.046947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:23.055326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f337c-198a-4a22-bc26-07e598d9a953 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:23.090583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8a091-6580-48c0-a83d-19f57ad46909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:23.091198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8a091-6580-48c0-a83d-19f57ad46909 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:23.091478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8a091-6580-48c0-a83d-19f57ad46909 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:23.091749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8a091-6580-48c0-a83d-19f57ad46909 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:23.092459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8a091-6580-48c0-a83d-19f57ad46909 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:23.092763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8a091-6580-48c0-a83d-19f57ad46909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:23.094177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8a091-6580-48c0-a83d-19f57ad46909 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:23.101950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 373/740] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:23.103283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa032321-51f3-4fa6-b4bc-f91a9270d7ab None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:23.103583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa032321-51f3-4fa6-b4bc-f91a9270d7ab None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:23.103856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa032321-51f3-4fa6-b4bc-f91a9270d7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:23.121385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-aa032321-51f3-4fa6-b4bc-f91a9270d7ab None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:23.122569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aa032321-51f3-4fa6-b4bc-f91a9270d7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:23.128398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a75e-ef8c-450b-a152-4b6b3f682a3e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:23.169989 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8479a1-7b1e-4143-a55b-a68491423253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:23.170615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8479a1-7b1e-4143-a55b-a68491423253 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:23.170748 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:23.170894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8479a1-7b1e-4143-a55b-a68491423253 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:23.171160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8479a1-7b1e-4143-a55b-a68491423253 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:23.171960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8479a1-7b1e-4143-a55b-a68491423253 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:23.172263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8479a1-7b1e-4143-a55b-a68491423253 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:23.173725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8479a1-7b1e-4143-a55b-a68491423253 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:23.190880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 374/741] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 05:20:23.195709 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 368/742] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 05:20:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:23.195834 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa032321-51f3-4fa6-b4bc-f91a9270d7ab None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:23.195916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8479a1-7b1e-4143-a55b-a68491423253 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:23.275800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:23.290971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa032321-51f3-4fa6-b4bc-f91a9270d7ab None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:23.303025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8479a1-7b1e-4143-a55b-a68491423253 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:23.324865 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d38b-0567-4e1f-a2c4-a09616499933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:23.325529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d38b-0567-4e1f-a2c4-a09616499933 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:23.325806 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d38b-0567-4e1f-a2c4-a09616499933 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:23.326073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d38b-0567-4e1f-a2c4-a09616499933 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:23.326760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972d38b-0567-4e1f-a2c4-a09616499933 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:23.328115 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972d38b-0567-4e1f-a2c4-a09616499933 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:23.338000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0aade-f7dc-4fca-8f09-a2cc2d7110d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:23.338606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0aade-f7dc-4fca-8f09-a2cc2d7110d6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:23.338887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0aade-f7dc-4fca-8f09-a2cc2d7110d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:23.339158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0aade-f7dc-4fca-8f09-a2cc2d7110d6 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:23.339947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0aade-f7dc-4fca-8f09-a2cc2d7110d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:23.340250 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0aade-f7dc-4fca-8f09-a2cc2d7110d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:23.341704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0aade-f7dc-4fca-8f09-a2cc2d7110d6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:23.359109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 369/743] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 05:20:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:23.359899 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0aade-f7dc-4fca-8f09-a2cc2d7110d6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:23.420719 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 375/744] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:20:23 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:23.421593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d38b-0567-4e1f-a2c4-a09616499933 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:23.470749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0aade-f7dc-4fca-8f09-a2cc2d7110d6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:23.470976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:23.506605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:23.519847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b0c15-3aed-44da-9267-4fcc3c734deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:23.520505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0c15-3aed-44da-9267-4fcc3c734deb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:23.520789 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0c15-3aed-44da-9267-4fcc3c734deb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:23.521058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0c15-3aed-44da-9267-4fcc3c734deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:23.533165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b0c15-3aed-44da-9267-4fcc3c734deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:23.534664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b0c15-3aed-44da-9267-4fcc3c734deb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:23.539680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d38b-0567-4e1f-a2c4-a09616499933 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8d4b0c15-3aed-44da-9267-4fcc3c734deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:23.551993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:23.552966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:23.554070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:23.554070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:23.554070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:23.554070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:23.554070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 370/745] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:23.554373 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b0c15-3aed-44da-9267-4fcc3c734deb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:23.584991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233d9bc-4f1b-4a6d-a9d1-c70c906f116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:23.585763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d9bc-4f1b-4a6d-a9d1-c70c906f116e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:23.586050 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d9bc-4f1b-4a6d-a9d1-c70c906f116e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:23.586315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d9bc-4f1b-4a6d-a9d1-c70c906f116e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:23.668582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b0c15-3aed-44da-9267-4fcc3c734deb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:23.668864 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233d9bc-4f1b-4a6d-a9d1-c70c906f116e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:23.670656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233d9bc-4f1b-4a6d-a9d1-c70c906f116e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:23.703471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1bfb5-c910-4608-b28a-eee46c40f737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:23.704089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1bfb5-c910-4608-b28a-eee46c40f737 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:23.704365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1bfb5-c910-4608-b28a-eee46c40f737 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:23.704632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1bfb5-c910-4608-b28a-eee46c40f737 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:23.705348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1bfb5-c910-4608-b28a-eee46c40f737 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:23.706718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1bfb5-c910-4608-b28a-eee46c40f737 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:23.716152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:23.762166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 371/746] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:20:23 2022] POST /identity/v3/services => generated 240 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:23.770607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1bfb5-c910-4608-b28a-eee46c40f737 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:23.785207 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 376/747] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:23 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 05:20:23.786552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233d9bc-4f1b-4a6d-a9d1-c70c906f116e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:23.844215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:23.922443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233d9bc-4f1b-4a6d-a9d1-c70c906f116e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:23.931182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1bfb5-c910-4608-b28a-eee46c40f737 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:23.972668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef56167-2206-4daa-8515-e96bff3ad2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:23.973306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459cdc0-6ad1-4432-9c9b-26406fd82d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:23.973427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef56167-2206-4daa-8515-e96bff3ad2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:23.973646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef56167-2206-4daa-8515-e96bff3ad2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:23.973951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459cdc0-6ad1-4432-9c9b-26406fd82d77 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:23.974051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef56167-2206-4daa-8515-e96bff3ad2a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:23.974227 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459cdc0-6ad1-4432-9c9b-26406fd82d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:23.974796 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459cdc0-6ad1-4432-9c9b-26406fd82d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:23.974906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef56167-2206-4daa-8515-e96bff3ad2a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:23.974982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef56167-2206-4daa-8515-e96bff3ad2a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:23.976464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef56167-2206-4daa-8515-e96bff3ad2a5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:23.986561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:23.988575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459cdc0-6ad1-4432-9c9b-26406fd82d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:23.990278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459cdc0-6ad1-4432-9c9b-26406fd82d77 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:23.990418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 377/748] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:23.991173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef56167-2206-4daa-8515-e96bff3ad2a5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c459cdc0-6ad1-4432-9c9b-26406fd82d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:24.011827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:24.012808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:24.013757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:24.013757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:24.013757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:24.013757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:24.016332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 372/749] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:24.021679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459cdc0-6ad1-4432-9c9b-26406fd82d77 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:24.103664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef56167-2206-4daa-8515-e96bff3ad2a5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:24.113621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:24.126274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459cdc0-6ad1-4432-9c9b-26406fd82d77 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:24.143270 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595fd43-63bc-41ee-8a42-f8cff1558c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:24.144294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595fd43-63bc-41ee-8a42-f8cff1558c7a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:24.144783 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595fd43-63bc-41ee-8a42-f8cff1558c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:24.145301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595fd43-63bc-41ee-8a42-f8cff1558c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:24.159603 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595fd43-63bc-41ee-8a42-f8cff1558c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:24.161442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595fd43-63bc-41ee-8a42-f8cff1558c7a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:24.163928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a693-f73c-4a93-8120-59d8d46b9c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:24.164811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a693-f73c-4a93-8120-59d8d46b9c7e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:24.164811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a693-f73c-4a93-8120-59d8d46b9c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:24.165730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a693-f73c-4a93-8120-59d8d46b9c7e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:24.175671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44a693-f73c-4a93-8120-59d8d46b9c7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:24.177411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44a693-f73c-4a93-8120-59d8d46b9c7e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5595fd43-63bc-41ee-8a42-f8cff1558c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:24.180613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:24.181823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:24.182758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:24.182758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:24.182758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:24.182758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9a44a693-f73c-4a93-8120-59d8d46b9c7e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:24.189338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:24.190306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 373/751] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 05:20:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:24.191830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a693-f73c-4a93-8120-59d8d46b9c7e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:24.192772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 378/751] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:24.195310 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595fd43-63bc-41ee-8a42-f8cff1558c7a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:24.251949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:24.295506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a693-f73c-4a93-8120-59d8d46b9c7e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:24.307461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595fd43-63bc-41ee-8a42-f8cff1558c7a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:24.332159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffcf6f-0fca-4f86-bb5a-c1a5aed96da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:24.332909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffcf6f-0fca-4f86-bb5a-c1a5aed96da9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:24.333205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffcf6f-0fca-4f86-bb5a-c1a5aed96da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:24.333479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffcf6f-0fca-4f86-bb5a-c1a5aed96da9 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:24.334190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffcf6f-0fca-4f86-bb5a-c1a5aed96da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:24.334707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffcf6f-0fca-4f86-bb5a-c1a5aed96da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:24.335950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffcf6f-0fca-4f86-bb5a-c1a5aed96da9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:24.350452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 374/752] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:24.351672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffcf6f-0fca-4f86-bb5a-c1a5aed96da9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:24.357895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fea7d8-9254-44f2-9ed0-5c1795466ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:24.359124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fea7d8-9254-44f2-9ed0-5c1795466ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:24.359635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fea7d8-9254-44f2-9ed0-5c1795466ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:24.360124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fea7d8-9254-44f2-9ed0-5c1795466ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:24.361026 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fea7d8-9254-44f2-9ed0-5c1795466ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:24.361564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fea7d8-9254-44f2-9ed0-5c1795466ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:24.363144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fea7d8-9254-44f2-9ed0-5c1795466ef0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:24.366645 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:24.378069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 379/753] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:24.379160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fea7d8-9254-44f2-9ed0-5c1795466ef0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:24.486205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffcf6f-0fca-4f86-bb5a-c1a5aed96da9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:24.492396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fea7d8-9254-44f2-9ed0-5c1795466ef0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:24.507323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:24.523478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5b539-978c-43a0-8ef6-0c187b8b6082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:24.524099 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5b539-978c-43a0-8ef6-0c187b8b6082 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:24.524430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5b539-978c-43a0-8ef6-0c187b8b6082 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:24.526041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5b539-978c-43a0-8ef6-0c187b8b6082 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:24.526041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5b539-978c-43a0-8ef6-0c187b8b6082 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:24.526041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5b539-978c-43a0-8ef6-0c187b8b6082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:24.527220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5b539-978c-43a0-8ef6-0c187b8b6082 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:24.531889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d73b3-788a-4b76-adba-67ce3e0ec9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:24.532857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d73b3-788a-4b76-adba-67ce3e0ec9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:24.533404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d73b3-788a-4b76-adba-67ce3e0ec9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:24.533880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d73b3-788a-4b76-adba-67ce3e0ec9b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:24.541967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d73b3-788a-4b76-adba-67ce3e0ec9b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:24.543681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d73b3-788a-4b76-adba-67ce3e0ec9b6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:24.547268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 375/754] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 05:20:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:24.548240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5b539-978c-43a0-8ef6-0c187b8b6082 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fd9d73b3-788a-4b76-adba-67ce3e0ec9b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:24.558769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:24.559715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:24.560633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:24.560633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:24.560633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:24.560633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:24.560633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:24.560633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:24.560633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:24.560633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:24.563178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 380/755] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:24.564312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d73b3-788a-4b76-adba-67ce3e0ec9b6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:24.637673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:24.677807 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5b539-978c-43a0-8ef6-0c187b8b6082 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:24.692374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d73b3-788a-4b76-adba-67ce3e0ec9b6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:24.731330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b69cd-a54c-4fc0-aa0e-d40f826cc303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:24.732373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b69cd-a54c-4fc0-aa0e-d40f826cc303 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:24.732865 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b69cd-a54c-4fc0-aa0e-d40f826cc303 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:24.733389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b69cd-a54c-4fc0-aa0e-d40f826cc303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:24.781830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:24.813003 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b69cd-a54c-4fc0-aa0e-d40f826cc303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:24.814837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b69cd-a54c-4fc0-aa0e-d40f826cc303 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:24.842561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d25bad-bf2c-45e3-a99c-733a7496f4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:24.843615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d25bad-bf2c-45e3-a99c-733a7496f4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:24.844103 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d25bad-bf2c-45e3-a99c-733a7496f4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:24.844593 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d25bad-bf2c-45e3-a99c-733a7496f4d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:24.852197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d25bad-bf2c-45e3-a99c-733a7496f4d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:24.854030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d25bad-bf2c-45e3-a99c-733a7496f4d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-01d25bad-bf2c-45e3-a99c-733a7496f4d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:24.866749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:24.867685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:24.869121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:24.869121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:24.869121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:24.869121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:24.869121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:24.869121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:24.869121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:24.869121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:24.871734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 376/756] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:24.872800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d25bad-bf2c-45e3-a99c-733a7496f4d2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:24.923820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 381/757] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:20:24.924665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b69cd-a54c-4fc0-aa0e-d40f826cc303 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:25.004311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:25.007694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d25bad-bf2c-45e3-a99c-733a7496f4d2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:25.036572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:25.045389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b69cd-a54c-4fc0-aa0e-d40f826cc303 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:25.046291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607528e-2cf4-48ea-93e7-c8924381d6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:25.046913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607528e-2cf4-48ea-93e7-c8924381d6ee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:25.047191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607528e-2cf4-48ea-93e7-c8924381d6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:25.047542 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607528e-2cf4-48ea-93e7-c8924381d6ee None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:25.048281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607528e-2cf4-48ea-93e7-c8924381d6ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:25.048688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607528e-2cf4-48ea-93e7-c8924381d6ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:25.050326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607528e-2cf4-48ea-93e7-c8924381d6ee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:25.064655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 377/758] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:25.065727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607528e-2cf4-48ea-93e7-c8924381d6ee None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:25.090148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8ceab-8a6c-45bf-a669-c233b7055a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:25.090773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8ceab-8a6c-45bf-a669-c233b7055a5c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:25.091056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8ceab-8a6c-45bf-a669-c233b7055a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:25.091330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8ceab-8a6c-45bf-a669-c233b7055a5c None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:25.092082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8ceab-8a6c-45bf-a669-c233b7055a5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:25.092702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8ceab-8a6c-45bf-a669-c233b7055a5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:25.093903 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8ceab-8a6c-45bf-a669-c233b7055a5c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:25.112370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 382/759] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:25.112370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8ceab-8a6c-45bf-a669-c233b7055a5c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:25.202440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607528e-2cf4-48ea-93e7-c8924381d6ee None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:25.221539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8ceab-8a6c-45bf-a669-c233b7055a5c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:25.249333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b62253-9d56-419b-96ac-61427d75d733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:25.250216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b62253-9d56-419b-96ac-61427d75d733 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:25.250894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b62253-9d56-419b-96ac-61427d75d733 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:25.251343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b62253-9d56-419b-96ac-61427d75d733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:25.255119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:25.260862 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7fa56-6afb-4844-90ff-4e22ea99a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:25.262180 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7fa56-6afb-4844-90ff-4e22ea99a499 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:25.262524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7fa56-6afb-4844-90ff-4e22ea99a499 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:25.262919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7fa56-6afb-4844-90ff-4e22ea99a499 None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/531ebc9dee0440888b94a6bf17d7a335/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:25.266519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7fa56-6afb-4844-90ff-4e22ea99a499 None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=531ebc9dee0440888b94a6bf17d7a335, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:25.266635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b62253-9d56-419b-96ac-61427d75d733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:25.267407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7fa56-6afb-4844-90ff-4e22ea99a499 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:25.267978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b62253-9d56-419b-96ac-61427d75d733 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-62b62253-9d56-419b-96ac-61427d75d733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:25.284508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:25.285520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:25.286426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:25.286426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:25.286426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:25.286426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:25.287472 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 378/760] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:25.288540 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b62253-9d56-419b-96ac-61427d75d733 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:25.331984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:25.346511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 383/761] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:20:25 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/531ebc9dee0440888b94a6bf17d7a335/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:20:25.347964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7fa56-6afb-4844-90ff-4e22ea99a499 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:25.428411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b62253-9d56-419b-96ac-61427d75d733 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:25.482054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7fa56-6afb-4844-90ff-4e22ea99a499 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:25.511350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa98101-9d6b-47c8-9c17-4120e8ba77b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:25.512033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa98101-9d6b-47c8-9c17-4120e8ba77b5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:25.512318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa98101-9d6b-47c8-9c17-4120e8ba77b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:25.512596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa98101-9d6b-47c8-9c17-4120e8ba77b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:25.513567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa98101-9d6b-47c8-9c17-4120e8ba77b5 None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=ef24fa7356ac455b8994e0e6d1959654) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:25.513938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa98101-9d6b-47c8-9c17-4120e8ba77b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:25.515577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa98101-9d6b-47c8-9c17-4120e8ba77b5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:25.533167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 379/762] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:25 2022] GET /identity/v3/role_assignments?user.id=ef24fa7356ac455b8994e0e6d1959654&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=57a86ff4c9de433399662eebf6893065 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:25.533167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7336d-be2b-4349-88f6-6bac3731e746 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:25.533167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7336d-be2b-4349-88f6-6bac3731e746 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:25.533167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7336d-be2b-4349-88f6-6bac3731e746 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:25.534534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 380/763] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:25.536045 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f20c53-6fdb-4438-9343-754b61ff85e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:25.536205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0786-e80f-4dc3-a89e-9da1620f1a9a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:25.536404 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0786-e80f-4dc3-a89e-9da1620f1a9a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:25.536611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0786-e80f-4dc3-a89e-9da1620f1a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:25.537490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20c53-6fdb-4438-9343-754b61ff85e7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:25.537997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20c53-6fdb-4438-9343-754b61ff85e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:25.538485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20c53-6fdb-4438-9343-754b61ff85e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:25.539413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f20c53-6fdb-4438-9343-754b61ff85e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:25.539924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f20c53-6fdb-4438-9343-754b61ff85e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:25.542306 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f20c53-6fdb-4438-9343-754b61ff85e7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:25.566994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 384/764] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:25.570259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-784b0786-e80f-4dc3-a89e-9da1620f1a9a None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:25.572042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-784b0786-e80f-4dc3-a89e-9da1620f1a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:25.573344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f20c53-6fdb-4438-9343-754b61ff85e7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:25.642001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:25.671210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 381/765] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:25.706346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f20c53-6fdb-4438-9343-754b61ff85e7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:25.718824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b0786-e80f-4dc3-a89e-9da1620f1a9a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:25.781001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:25.788777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cfb6a-47df-49dd-83bf-7f391f530930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:25.789764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cfb6a-47df-49dd-83bf-7f391f530930 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:25.790361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cfb6a-47df-49dd-83bf-7f391f530930 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:25.791018 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cfb6a-47df-49dd-83bf-7f391f530930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:25.817347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cfb6a-47df-49dd-83bf-7f391f530930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:25.820393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cfb6a-47df-49dd-83bf-7f391f530930 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-be3cfb6a-47df-49dd-83bf-7f391f530930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:25.847410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:25.848400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:25.849349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:25.849349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:25.849349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:25.849349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:25.849349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:25.849349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:25.849349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:25.849349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:25.857714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 385/766] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:25.858413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cfb6a-47df-49dd-83bf-7f391f530930 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:25.895654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b0786-e80f-4dc3-a89e-9da1620f1a9a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:25.969326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a166ff-c80e-429d-a87f-4466a5e3fd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:25.969982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a166ff-c80e-429d-a87f-4466a5e3fd49 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:25.970258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a166ff-c80e-429d-a87f-4466a5e3fd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:25.970526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a166ff-c80e-429d-a87f-4466a5e3fd49 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:25.971167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a166ff-c80e-429d-a87f-4466a5e3fd49 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:25.972545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a166ff-c80e-429d-a87f-4466a5e3fd49 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e9a166ff-c80e-429d-a87f-4466a5e3fd49 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:25.988064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:25.989081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:20:25.989968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:26.002914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cfb6a-47df-49dd-83bf-7f391f530930 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:26.004463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 382/767] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 05:20:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:26.014377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a166ff-c80e-429d-a87f-4466a5e3fd49 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:26.030201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:26.057845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605ecc6-9bb0-441e-b2f7-cfc3f94a75ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:26.058478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605ecc6-9bb0-441e-b2f7-cfc3f94a75ce None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:26.058758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605ecc6-9bb0-441e-b2f7-cfc3f94a75ce None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:26.059032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605ecc6-9bb0-441e-b2f7-cfc3f94a75ce None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:26.059788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605ecc6-9bb0-441e-b2f7-cfc3f94a75ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:26.060092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605ecc6-9bb0-441e-b2f7-cfc3f94a75ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:26.062314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605ecc6-9bb0-441e-b2f7-cfc3f94a75ce None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:26.078866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 386/768] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:26.080326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d595a62-5e8d-457a-b12d-aad02cd37471 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:26.080594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d595a62-5e8d-457a-b12d-aad02cd37471 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:26.080869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d595a62-5e8d-457a-b12d-aad02cd37471 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:26.086913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 387/769] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:26.086913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d595a62-5e8d-457a-b12d-aad02cd37471 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:26.132136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:26.138940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a166ff-c80e-429d-a87f-4466a5e3fd49 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:26.189089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27aec9c-a15c-4071-a068-dc6ebacdf6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:26.190209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aec9c-a15c-4071-a068-dc6ebacdf6de None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:26.190793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aec9c-a15c-4071-a068-dc6ebacdf6de None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:26.191264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aec9c-a15c-4071-a068-dc6ebacdf6de None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:26.192169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aec9c-a15c-4071-a068-dc6ebacdf6de None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:26.192675 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aec9c-a15c-4071-a068-dc6ebacdf6de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:26.194498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aec9c-a15c-4071-a068-dc6ebacdf6de None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:26.199931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 383/770] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 05:20:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:26.201612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c3050-1cfc-4f6f-a418-2e9c38de8ea8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:26.202128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c3050-1cfc-4f6f-a418-2e9c38de8ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:26.202639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c3050-1cfc-4f6f-a418-2e9c38de8ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:26.218064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d595a62-5e8d-457a-b12d-aad02cd37471 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:26.222782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f67c3050-1cfc-4f6f-a418-2e9c38de8ea8 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:26.224210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f67c3050-1cfc-4f6f-a418-2e9c38de8ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:26.265629 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0bdf5-b2c5-4730-9ba5-293b5bdcea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:26.266260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0bdf5-b2c5-4730-9ba5-293b5bdcea40 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:26.266538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0bdf5-b2c5-4730-9ba5-293b5bdcea40 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:26.266807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0bdf5-b2c5-4730-9ba5-293b5bdcea40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:26.267601 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0bdf5-b2c5-4730-9ba5-293b5bdcea40 None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=c8577537a1a84cffb5d8aebc4f41e8e0) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:26.267910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0bdf5-b2c5-4730-9ba5-293b5bdcea40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:26.269364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0bdf5-b2c5-4730-9ba5-293b5bdcea40 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:26.276139 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 388/771] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:26 2022] GET /identity/v3/role_assignments?user.id=c8577537a1a84cffb5d8aebc4f41e8e0&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:26.277007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0bdf5-b2c5-4730-9ba5-293b5bdcea40 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:26.324226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 384/772] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:26.334893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:26.360658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c3050-1cfc-4f6f-a418-2e9c38de8ea8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:26.464920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0bdf5-b2c5-4730-9ba5-293b5bdcea40 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:26.470370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:26.482070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c3050-1cfc-4f6f-a418-2e9c38de8ea8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:26.525406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5e24-5621-42dd-970f-3f98e2cd695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:26.526051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5e24-5621-42dd-970f-3f98e2cd695f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:26.526325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5e24-5621-42dd-970f-3f98e2cd695f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:26.526592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5e24-5621-42dd-970f-3f98e2cd695f None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:26.527213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb5e24-5621-42dd-970f-3f98e2cd695f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:26.528569 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb5e24-5621-42dd-970f-3f98e2cd695f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:26.530388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb487-b053-4178-b1c0-39c893a4d636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:26.531008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb487-b053-4178-b1c0-39c893a4d636 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:26.531279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb487-b053-4178-b1c0-39c893a4d636 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:26.531545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb487-b053-4178-b1c0-39c893a4d636 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:26.532217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb487-b053-4178-b1c0-39c893a4d636 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:26.532511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb487-b053-4178-b1c0-39c893a4d636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:26.533876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb487-b053-4178-b1c0-39c893a4d636 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:26.540608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 389/773] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 05:20:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c5fb5e24-5621-42dd-970f-3f98e2cd695f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:26.543583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:26.544602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:20:26.545504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:26.546283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb487-b053-4178-b1c0-39c893a4d636 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:26.548425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 385/774] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:26 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:26.554763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5e24-5621-42dd-970f-3f98e2cd695f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:26.691876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5e24-5621-42dd-970f-3f98e2cd695f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:26.699976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:26.709200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb487-b053-4178-b1c0-39c893a4d636 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:26.748440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7aa2e-7a67-4c7a-a663-9735a13fcac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:26.749087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7aa2e-7a67-4c7a-a663-9735a13fcac9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:26.749396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7aa2e-7a67-4c7a-a663-9735a13fcac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:26.749672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7aa2e-7a67-4c7a-a663-9735a13fcac9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:26.750450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7aa2e-7a67-4c7a-a663-9735a13fcac9 None admin] RBAC: Adding query filter params (interface=public, service_id=3f27f3065a9343e5bb7cbf9023637606, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:26.750762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7aa2e-7a67-4c7a-a663-9735a13fcac9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:26.752183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7aa2e-7a67-4c7a-a663-9735a13fcac9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:26.762605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5027261-6b1f-4755-b548-95d60ae9e80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:26.763247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5027261-6b1f-4755-b548-95d60ae9e80d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:26.763528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5027261-6b1f-4755-b548-95d60ae9e80d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:26.763800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5027261-6b1f-4755-b548-95d60ae9e80d None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:26.764500 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5027261-6b1f-4755-b548-95d60ae9e80d None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:26.764804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5027261-6b1f-4755-b548-95d60ae9e80d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:26.766240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5027261-6b1f-4755-b548-95d60ae9e80d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:26.775004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 390/775] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 05:20:26 2022] GET /identity/v3/endpoints?service_id=3f27f3065a9343e5bb7cbf9023637606&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:26.780628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7aa2e-7a67-4c7a-a663-9735a13fcac9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:26.781297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 386/776] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:26.787291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5027261-6b1f-4755-b548-95d60ae9e80d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:26.825600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:26.910748 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7aa2e-7a67-4c7a-a663-9735a13fcac9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:26.946580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34bfda-4011-4a4b-bfb4-1e676412a451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:26.947130 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bfda-4011-4a4b-bfb4-1e676412a451 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:26.947415 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bfda-4011-4a4b-bfb4-1e676412a451 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:26.947691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34bfda-4011-4a4b-bfb4-1e676412a451 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:26.948340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34bfda-4011-4a4b-bfb4-1e676412a451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:26.949750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34bfda-4011-4a4b-bfb4-1e676412a451 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:26.955470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 391/777] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 05:20:26 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:27.051441 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5027261-6b1f-4755-b548-95d60ae9e80d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:27.078001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9adaff-61f2-4423-b432-ab3088c8a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:27.078624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9adaff-61f2-4423-b432-ab3088c8a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:27.078898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9adaff-61f2-4423-b432-ab3088c8a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:27.079161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9adaff-61f2-4423-b432-ab3088c8a1a0 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:27.079839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9adaff-61f2-4423-b432-ab3088c8a1a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:27.080134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9adaff-61f2-4423-b432-ab3088c8a1a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:27.081517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9adaff-61f2-4423-b432-ab3088c8a1a0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:27.101624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 387/778] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:27.110617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34bfda-4011-4a4b-bfb4-1e676412a451 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:27.166075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:27.261118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34bfda-4011-4a4b-bfb4-1e676412a451 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:27.313883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5e360-737b-4537-9117-84c9799ef4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:27.314888 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5e360-737b-4537-9117-84c9799ef4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:27.315372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5e360-737b-4537-9117-84c9799ef4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:27.315845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5e360-737b-4537-9117-84c9799ef4f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:27.316840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5e360-737b-4537-9117-84c9799ef4f7 None admin] RBAC: Adding query filter params (interface=public, service_id=e10735bbfdeb4ae490e62a7803c018b5, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:27.317373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5e360-737b-4537-9117-84c9799ef4f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:27.318953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5e360-737b-4537-9117-84c9799ef4f7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:27.325315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 392/779] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 05:20:27 2022] GET /identity/v3/endpoints?service_id=e10735bbfdeb4ae490e62a7803c018b5&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:27.330843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9adaff-61f2-4423-b432-ab3088c8a1a0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:27.444780 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:27.471443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9adaff-61f2-4423-b432-ab3088c8a1a0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:27.515515 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2376f3-55a8-43ca-ac7f-d3a4fb5d2b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:27.516537 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2376f3-55a8-43ca-ac7f-d3a4fb5d2b8c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:27.517424 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2376f3-55a8-43ca-ac7f-d3a4fb5d2b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:27.517693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2376f3-55a8-43ca-ac7f-d3a4fb5d2b8c None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:27.518345 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2376f3-55a8-43ca-ac7f-d3a4fb5d2b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:27.519835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2376f3-55a8-43ca-ac7f-d3a4fb5d2b8c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:27.526165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 388/780] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 05:20:27 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:27.754410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced11f47-07bd-4214-ab96-4af4f3d2bf07 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:27.754943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced11f47-07bd-4214-ab96-4af4f3d2bf07 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:27.754943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced11f47-07bd-4214-ab96-4af4f3d2bf07 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:27.756598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 393/781] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:27.762778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342b188-3d5b-4e02-9d81-c2b9326e54e5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:27.763061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342b188-3d5b-4e02-9d81-c2b9326e54e5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:27.763330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342b188-3d5b-4e02-9d81-c2b9326e54e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:27.782062 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e342b188-3d5b-4e02-9d81-c2b9326e54e5 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:27.783199 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e342b188-3d5b-4e02-9d81-c2b9326e54e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:27.873152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 389/782] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:27.900350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced11f47-07bd-4214-ab96-4af4f3d2bf07 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:27.924743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091290d-3d4f-488f-8f58-4e7028f26d69 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:27.925028 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091290d-3d4f-488f-8f58-4e7028f26d69 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:27.925345 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091290d-3d4f-488f-8f58-4e7028f26d69 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:27.927234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 390/783] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:27.934792 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe7af1-75b8-4b67-a8e9-a8a86162d10c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:27.935082 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe7af1-75b8-4b67-a8e9-a8a86162d10c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:27.935361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe7af1-75b8-4b67-a8e9-a8a86162d10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:27.969301 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dbbe7af1-75b8-4b67-a8e9-a8a86162d10c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:27.970505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dbbe7af1-75b8-4b67-a8e9-a8a86162d10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:28.025566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:28.035275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced11f47-07bd-4214-ab96-4af4f3d2bf07 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:28.074934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962b3ef-fe8f-4691-b6b0-24a18ad67aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:28.075741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962b3ef-fe8f-4691-b6b0-24a18ad67aef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:28.076028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962b3ef-fe8f-4691-b6b0-24a18ad67aef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:28.076307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962b3ef-fe8f-4691-b6b0-24a18ad67aef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:28.103420 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962b3ef-fe8f-4691-b6b0-24a18ad67aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6962b3ef-fe8f-4691-b6b0-24a18ad67aef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:28.112507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:28.113478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:28.114343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:28.117985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 394/784] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:28.123612 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962b3ef-fe8f-4691-b6b0-24a18ad67aef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:28.140857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 391/785] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:28.204878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe7af1-75b8-4b67-a8e9-a8a86162d10c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:28.237537 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:28.318466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe7af1-75b8-4b67-a8e9-a8a86162d10c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:28.359236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ee15a-68bb-4370-bffa-5243c3aa346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:28.359894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ee15a-68bb-4370-bffa-5243c3aa346d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:28.360184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ee15a-68bb-4370-bffa-5243c3aa346d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:28.360461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ee15a-68bb-4370-bffa-5243c3aa346d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:28.372503 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ee15a-68bb-4370-bffa-5243c3aa346d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c72ee15a-68bb-4370-bffa-5243c3aa346d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:28.377772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:28.378963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:28.380100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 392/786] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:28.385936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ee15a-68bb-4370-bffa-5243c3aa346d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:28.393169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962b3ef-fe8f-4691-b6b0-24a18ad67aef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:28.456698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:28.461936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b50652-f382-48c6-90d2-cb26f999eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:28.462615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b50652-f382-48c6-90d2-cb26f999eefe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:28.462897 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b50652-f382-48c6-90d2-cb26f999eefe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:28.463168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b50652-f382-48c6-90d2-cb26f999eefe None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:28.463891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b50652-f382-48c6-90d2-cb26f999eefe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:28.464194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b50652-f382-48c6-90d2-cb26f999eefe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:28.471692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b50652-f382-48c6-90d2-cb26f999eefe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:28.488830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 395/787] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:20:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:28.492160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b50652-f382-48c6-90d2-cb26f999eefe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:28.513259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:28.520413 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ee15a-68bb-4370-bffa-5243c3aa346d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:28.618460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17571d1-1b3a-40f7-a703-133c13ceec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:28.619139 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17571d1-1b3a-40f7-a703-133c13ceec83 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:28.619421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17571d1-1b3a-40f7-a703-133c13ceec83 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:28.619691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17571d1-1b3a-40f7-a703-133c13ceec83 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:28.620415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17571d1-1b3a-40f7-a703-133c13ceec83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:28.620719 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17571d1-1b3a-40f7-a703-133c13ceec83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:28.622128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17571d1-1b3a-40f7-a703-133c13ceec83 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:28.639475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b50652-f382-48c6-90d2-cb26f999eefe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:28.640645 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 393/788] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:20:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:28.645765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17571d1-1b3a-40f7-a703-133c13ceec83 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:28.684246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e116caf-feed-4aa7-9f69-2f493fd6e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:28.684903 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e116caf-feed-4aa7-9f69-2f493fd6e6ae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:28.685196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e116caf-feed-4aa7-9f69-2f493fd6e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:28.685473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e116caf-feed-4aa7-9f69-2f493fd6e6ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:28.706390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e116caf-feed-4aa7-9f69-2f493fd6e6ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:28.707849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e116caf-feed-4aa7-9f69-2f493fd6e6ae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7e116caf-feed-4aa7-9f69-2f493fd6e6ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:28.739431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:28.740388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:28.742605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:28.742605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:28.742605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:28.742605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:28.742605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 396/789] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:28.746137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e116caf-feed-4aa7-9f69-2f493fd6e6ae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:28.828056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17571d1-1b3a-40f7-a703-133c13ceec83 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:28.848762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:28.856554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:28.865826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5a64c-cf57-4ce4-b7d7-845a29366bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:28.866946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a64c-cf57-4ce4-b7d7-845a29366bfc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:28.873332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a64c-cf57-4ce4-b7d7-845a29366bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:28.873332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a64c-cf57-4ce4-b7d7-845a29366bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:28.882802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5a64c-cf57-4ce4-b7d7-845a29366bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:28.885562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5a64c-cf57-4ce4-b7d7-845a29366bfc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:28.889545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e116caf-feed-4aa7-9f69-2f493fd6e6ae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2fb5a64c-cf57-4ce4-b7d7-845a29366bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:28.908992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:28.911018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:28.912025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:28.912025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:28.912025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:28.912025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:28.912025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 394/790] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:28.912305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb0593-ddac-4c00-989e-358df1906f4d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:28.914321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb0593-ddac-4c00-989e-358df1906f4d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:28.914321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb0593-ddac-4c00-989e-358df1906f4d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:28.914321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 395/791] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:28.919007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb0593-ddac-4c00-989e-358df1906f4d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:28.941650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db745a41-a58d-4e16-9096-e62d446ede2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:28.942439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db745a41-a58d-4e16-9096-e62d446ede2c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:28.942873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db745a41-a58d-4e16-9096-e62d446ede2c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:28.943296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db745a41-a58d-4e16-9096-e62d446ede2c None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:28.944232 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db745a41-a58d-4e16-9096-e62d446ede2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:28.944628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db745a41-a58d-4e16-9096-e62d446ede2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:28.946703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db745a41-a58d-4e16-9096-e62d446ede2c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:28.960777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 397/792] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:28.963199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72167a5a-7404-4e06-b7e0-a5131b03c7c2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:28.963785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72167a5a-7404-4e06-b7e0-a5131b03c7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:28.964358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72167a5a-7404-4e06-b7e0-a5131b03c7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:28.983211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-72167a5a-7404-4e06-b7e0-a5131b03c7c2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:28.984530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-72167a5a-7404-4e06-b7e0-a5131b03c7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:29.050300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb0593-ddac-4c00-989e-358df1906f4d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:29.061494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 398/793] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:29.062745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72167a5a-7404-4e06-b7e0-a5131b03c7c2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:29.089024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d63f1a-f6e2-4a2b-85bf-e70593ea24b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:29.089670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d63f1a-f6e2-4a2b-85bf-e70593ea24b4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.090050 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d63f1a-f6e2-4a2b-85bf-e70593ea24b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.090323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d63f1a-f6e2-4a2b-85bf-e70593ea24b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:29.091013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d63f1a-f6e2-4a2b-85bf-e70593ea24b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:29.091313 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d63f1a-f6e2-4a2b-85bf-e70593ea24b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:29.092784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d63f1a-f6e2-4a2b-85bf-e70593ea24b4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:29.107594 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 396/794] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:29.108567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d63f1a-f6e2-4a2b-85bf-e70593ea24b4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:29.158918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:29.162380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:29.217673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72167a5a-7404-4e06-b7e0-a5131b03c7c2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:29.233186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d63f1a-f6e2-4a2b-85bf-e70593ea24b4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:29.269147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38ccb1-0d1c-4e0b-8194-1e1ec58aec22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:29.269906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38ccb1-0d1c-4e0b-8194-1e1ec58aec22 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.270268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38ccb1-0d1c-4e0b-8194-1e1ec58aec22 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.270556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38ccb1-0d1c-4e0b-8194-1e1ec58aec22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:29.273524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240424aa-ecca-4ec4-858b-98a7b806b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:29.275529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240424aa-ecca-4ec4-858b-98a7b806b65c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.275994 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240424aa-ecca-4ec4-858b-98a7b806b65c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.276437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240424aa-ecca-4ec4-858b-98a7b806b65c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:29.279674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38ccb1-0d1c-4e0b-8194-1e1ec58aec22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:29.281147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38ccb1-0d1c-4e0b-8194-1e1ec58aec22 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:29.287482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240424aa-ecca-4ec4-858b-98a7b806b65c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-240424aa-ecca-4ec4-858b-98a7b806b65c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:29.293858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:29.294813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:29.295680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cd38ccb1-0d1c-4e0b-8194-1e1ec58aec22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:29.296331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:29.297198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:29.298209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:29.298209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:29.298209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:29.298209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:29.298209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:29.298209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:29.298209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:29.298209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:29.298209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:29.298209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:29.298748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 397/796] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:29.298748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240424aa-ecca-4ec4-858b-98a7b806b65c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:29.298880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 399/796] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 05:20:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:29.298880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d62aa-dfbc-4758-99bd-526b80350383 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.299975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d62aa-dfbc-4758-99bd-526b80350383 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.299975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d62aa-dfbc-4758-99bd-526b80350383 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:29.301114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 400/797] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:29.302047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d62aa-dfbc-4758-99bd-526b80350383 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:29.409217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:29.410129 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d62aa-dfbc-4758-99bd-526b80350383 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:29.412568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240424aa-ecca-4ec4-858b-98a7b806b65c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:29.428096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:29.446522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512298c6-11fb-4a84-867a-abf22b39960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:29.447144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512298c6-11fb-4a84-867a-abf22b39960f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.447428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512298c6-11fb-4a84-867a-abf22b39960f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.447702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512298c6-11fb-4a84-867a-abf22b39960f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:29.448414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512298c6-11fb-4a84-867a-abf22b39960f None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:29.448713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512298c6-11fb-4a84-867a-abf22b39960f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:29.449583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c12af-5616-4b86-8704-d9ff0228881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:29.450115 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512298c6-11fb-4a84-867a-abf22b39960f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:29.450226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c12af-5616-4b86-8704-d9ff0228881a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.450491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c12af-5616-4b86-8704-d9ff0228881a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.450763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c12af-5616-4b86-8704-d9ff0228881a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:29.463920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 401/798] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:29.464099 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c12af-5616-4b86-8704-d9ff0228881a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:29.464519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512298c6-11fb-4a84-867a-abf22b39960f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:29.464609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c12af-5616-4b86-8704-d9ff0228881a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-953c12af-5616-4b86-8704-d9ff0228881a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:29.478467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:29.485173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 398/799] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf04718-fa85-42bb-b8b5-d3eb5e2fcf0f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.486367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf04718-fa85-42bb-b8b5-d3eb5e2fcf0f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.487236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf04718-fa85-42bb-b8b5-d3eb5e2fcf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:29.502613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9cf04718-fa85-42bb-b8b5-d3eb5e2fcf0f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:29.503803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9cf04718-fa85-42bb-b8b5-d3eb5e2fcf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:29.574865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 399/800] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:29.575931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf04718-fa85-42bb-b8b5-d3eb5e2fcf0f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:29.576820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512298c6-11fb-4a84-867a-abf22b39960f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:29.622724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803f175-1a0a-446d-a06d-9a93ed890564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:29.623767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803f175-1a0a-446d-a06d-9a93ed890564 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.624046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803f175-1a0a-446d-a06d-9a93ed890564 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.624315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803f175-1a0a-446d-a06d-9a93ed890564 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:29.625480 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803f175-1a0a-446d-a06d-9a93ed890564 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:29.625789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803f175-1a0a-446d-a06d-9a93ed890564 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:29.627524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803f175-1a0a-446d-a06d-9a93ed890564 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:29.646434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 402/801] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 05:20:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:29.647244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803f175-1a0a-446d-a06d-9a93ed890564 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:29.682422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:29.684461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:29.692549 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf04718-fa85-42bb-b8b5-d3eb5e2fcf0f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:29.729307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e963-c0d5-4e7e-9142-3e2901b623d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:29.729964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e963-c0d5-4e7e-9142-3e2901b623d7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.730236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e963-c0d5-4e7e-9142-3e2901b623d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.730506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e963-c0d5-4e7e-9142-3e2901b623d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:29.741355 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e963-c0d5-4e7e-9142-3e2901b623d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:29.742832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e963-c0d5-4e7e-9142-3e2901b623d7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:29.756478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803f175-1a0a-446d-a06d-9a93ed890564 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8792e963-c0d5-4e7e-9142-3e2901b623d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:29.757843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:29.759833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:29.760740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:29.760740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:29.760740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:29.760740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:29.760740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 400/802] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:29.760740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e963-c0d5-4e7e-9142-3e2901b623d7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:29.801854 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1277083-f35a-497a-8d63-15b0260b3e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:29.802475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1277083-f35a-497a-8d63-15b0260b3e96 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.802755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1277083-f35a-497a-8d63-15b0260b3e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.803023 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1277083-f35a-497a-8d63-15b0260b3e96 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:29.803842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1277083-f35a-497a-8d63-15b0260b3e96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:29.804149 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1277083-f35a-497a-8d63-15b0260b3e96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:29.806025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1277083-f35a-497a-8d63-15b0260b3e96 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:29.823967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 403/803] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 05:20:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:29.824780 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1277083-f35a-497a-8d63-15b0260b3e96 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:29.876046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e963-c0d5-4e7e-9142-3e2901b623d7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:29.914492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09833646-432b-4488-968d-81f07880fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:29.915792 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09833646-432b-4488-968d-81f07880fd7e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.916066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09833646-432b-4488-968d-81f07880fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.916336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09833646-432b-4488-968d-81f07880fd7e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:29.916969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09833646-432b-4488-968d-81f07880fd7e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:29.918388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09833646-432b-4488-968d-81f07880fd7e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:29.921719 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:29.928921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1277083-f35a-497a-8d63-15b0260b3e96 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-09833646-432b-4488-968d-81f07880fd7e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:29.929067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:29.929988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:29.941242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 401/804] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 05:20:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:29.942142 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09833646-432b-4488-968d-81f07880fd7e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:29.943111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:29.972462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f7237-4c5c-4190-9098-935c817780f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:29.973540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7237-4c5c-4190-9098-935c817780f3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:29.973810 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7237-4c5c-4190-9098-935c817780f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:29.974079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f7237-4c5c-4190-9098-935c817780f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.036247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09833646-432b-4488-968d-81f07880fd7e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.046557 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f7237-4c5c-4190-9098-935c817780f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.048330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f7237-4c5c-4190-9098-935c817780f3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.070545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23186d41-8042-44e9-bb9d-ebf64c0d7328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:30.071180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23186d41-8042-44e9-bb9d-ebf64c0d7328 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.071528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23186d41-8042-44e9-bb9d-ebf64c0d7328 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.071732 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23186d41-8042-44e9-bb9d-ebf64c0d7328 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.072421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23186d41-8042-44e9-bb9d-ebf64c0d7328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:30.072728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23186d41-8042-44e9-bb9d-ebf64c0d7328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.074124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23186d41-8042-44e9-bb9d-ebf64c0d7328 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.085470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 402/805] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:30.086255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23186d41-8042-44e9-bb9d-ebf64c0d7328 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:30.138393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:30.145694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 404/806] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:20:30.146499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f7237-4c5c-4190-9098-935c817780f3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:30.155341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:30.192867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23186d41-8042-44e9-bb9d-ebf64c0d7328 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.226137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b65e8-65be-49d8-829d-b4def9903044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:30.226766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b65e8-65be-49d8-829d-b4def9903044 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.227039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b65e8-65be-49d8-829d-b4def9903044 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.227856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b65e8-65be-49d8-829d-b4def9903044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.238200 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b65e8-65be-49d8-829d-b4def9903044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.239647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b65e8-65be-49d8-829d-b4def9903044 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.247891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f7237-4c5c-4190-9098-935c817780f3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-eb8b65e8-65be-49d8-829d-b4def9903044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:30.253581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:30.254477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:30.255411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:30.255411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:30.255411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:30.255411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:30.255411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 403/807] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:30.255836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720379e-dd87-4d54-9962-615ce4bd6b7c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.256131 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720379e-dd87-4d54-9962-615ce4bd6b7c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.256372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720379e-dd87-4d54-9962-615ce4bd6b7c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.260868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 404/808] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:30.260868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720379e-dd87-4d54-9962-615ce4bd6b7c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:30.286258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469994f-5a81-4d9c-b797-553a21f1f002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:30.286881 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469994f-5a81-4d9c-b797-553a21f1f002 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.287163 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469994f-5a81-4d9c-b797-553a21f1f002 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.287438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469994f-5a81-4d9c-b797-553a21f1f002 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.288114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469994f-5a81-4d9c-b797-553a21f1f002 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:30.288418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469994f-5a81-4d9c-b797-553a21f1f002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.289836 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469994f-5a81-4d9c-b797-553a21f1f002 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.294300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 405/809] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 05:20:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:30.295061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469994f-5a81-4d9c-b797-553a21f1f002 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:30.353389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:30.360712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720379e-dd87-4d54-9962-615ce4bd6b7c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.377949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:30.395516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3f8ee-a927-4576-9913-1990265a52bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:30.405881 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469994f-5a81-4d9c-b797-553a21f1f002 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.406004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3f8ee-a927-4576-9913-1990265a52bf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.406004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3f8ee-a927-4576-9913-1990265a52bf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.406004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3f8ee-a927-4576-9913-1990265a52bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.406004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3f8ee-a927-4576-9913-1990265a52bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.406790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3f8ee-a927-4576-9913-1990265a52bf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9db3f8ee-a927-4576-9913-1990265a52bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:30.417647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:30.418666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 405/810] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 05:20:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:30.419946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3f8ee-a927-4576-9913-1990265a52bf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:30.433585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bacc59-6857-4c73-8b08-5d9561f57afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:30.434234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bacc59-6857-4c73-8b08-5d9561f57afc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.434515 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bacc59-6857-4c73-8b08-5d9561f57afc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.434790 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bacc59-6857-4c73-8b08-5d9561f57afc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.446493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bacc59-6857-4c73-8b08-5d9561f57afc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.447887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bacc59-6857-4c73-8b08-5d9561f57afc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c0bacc59-6857-4c73-8b08-5d9561f57afc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:30.463374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:30.464281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:30.465283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:30.465283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:30.465283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:30.465283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:30.465283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 406/811] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:30.465793 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ca393-5b24-4cb3-a5e4-51fb3a8ede1d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.466019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ca393-5b24-4cb3-a5e4-51fb3a8ede1d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.466251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ca393-5b24-4cb3-a5e4-51fb3a8ede1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.483677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-998ca393-5b24-4cb3-a5e4-51fb3a8ede1d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:30.484854 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-998ca393-5b24-4cb3-a5e4-51fb3a8ede1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:30.521274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3f8ee-a927-4576-9913-1990265a52bf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.550325 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 407/812] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:30.551419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ca393-5b24-4cb3-a5e4-51fb3a8ede1d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:30.564800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5efde-d949-40f5-9f0c-1fc7d3f958e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:30.565455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5efde-d949-40f5-9f0c-1fc7d3f958e4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.565737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5efde-d949-40f5-9f0c-1fc7d3f958e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.566009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5efde-d949-40f5-9f0c-1fc7d3f958e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.566696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5efde-d949-40f5-9f0c-1fc7d3f958e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:30.566999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5efde-d949-40f5-9f0c-1fc7d3f958e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.568369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5efde-d949-40f5-9f0c-1fc7d3f958e4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.581209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 406/813] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:30.582004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5efde-d949-40f5-9f0c-1fc7d3f958e4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:30.593079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:30.623483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:30.649805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ca393-5b24-4cb3-a5e4-51fb3a8ede1d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.681637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5efde-d949-40f5-9f0c-1fc7d3f958e4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.684110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ab043-1a5b-44e0-af74-a4ab77d45204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:30.684724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab043-1a5b-44e0-af74-a4ab77d45204 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.685002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab043-1a5b-44e0-af74-a4ab77d45204 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.685308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab043-1a5b-44e0-af74-a4ab77d45204 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.685982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab043-1a5b-44e0-af74-a4ab77d45204 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:30.686286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab043-1a5b-44e0-af74-a4ab77d45204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.687648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab043-1a5b-44e0-af74-a4ab77d45204 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.692402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 408/814] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 05:20:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:30.693185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ab043-1a5b-44e0-af74-a4ab77d45204 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:30.715329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37776b-230c-4b02-bc22-f9d1828df012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:30.715871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37776b-230c-4b02-bc22-f9d1828df012 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.716149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37776b-230c-4b02-bc22-f9d1828df012 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.716408 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37776b-230c-4b02-bc22-f9d1828df012 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.717232 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37776b-230c-4b02-bc22-f9d1828df012 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:30.717531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37776b-230c-4b02-bc22-f9d1828df012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.718946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37776b-230c-4b02-bc22-f9d1828df012 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.735502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 407/815] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 05:20:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:30.736294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37776b-230c-4b02-bc22-f9d1828df012 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:30.791066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ab043-1a5b-44e0-af74-a4ab77d45204 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.793310 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:30.827120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96362dc-df50-4d64-aa83-fddedb7ee004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:30.827739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96362dc-df50-4d64-aa83-fddedb7ee004 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.828020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96362dc-df50-4d64-aa83-fddedb7ee004 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.828288 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96362dc-df50-4d64-aa83-fddedb7ee004 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.828965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96362dc-df50-4d64-aa83-fddedb7ee004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:30.829294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96362dc-df50-4d64-aa83-fddedb7ee004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.830653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96362dc-df50-4d64-aa83-fddedb7ee004 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.833366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:30.838872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37776b-230c-4b02-bc22-f9d1828df012 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.841772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 409/816] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:30.842733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96362dc-df50-4d64-aa83-fddedb7ee004 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:30.872595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a38fc-d1c6-44f5-9263-ac3cfb8b0f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:30.873249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a38fc-d1c6-44f5-9263-ac3cfb8b0f1f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.873523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a38fc-d1c6-44f5-9263-ac3cfb8b0f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.873790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a38fc-d1c6-44f5-9263-ac3cfb8b0f1f None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.874404 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a38fc-d1c6-44f5-9263-ac3cfb8b0f1f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.875756 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a38fc-d1c6-44f5-9263-ac3cfb8b0f1f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-151a38fc-d1c6-44f5-9263-ac3cfb8b0f1f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:30.884896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:30.886010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:30.886855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 408/817] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:30 2022] GET /identity/v3/services/network => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:30.887676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a38fc-d1c6-44f5-9263-ac3cfb8b0f1f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:30.944791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96362dc-df50-4d64-aa83-fddedb7ee004 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.978269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d322ab-55ac-46ac-bcad-9c33ea5c79c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:30.978802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d322ab-55ac-46ac-bcad-9c33ea5c79c1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:30.979081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d322ab-55ac-46ac-bcad-9c33ea5c79c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:30.979354 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d322ab-55ac-46ac-bcad-9c33ea5c79c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:30.983995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a38fc-d1c6-44f5-9263-ac3cfb8b0f1f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:30.985850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d322ab-55ac-46ac-bcad-9c33ea5c79c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:30.987287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d322ab-55ac-46ac-bcad-9c33ea5c79c1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f3d322ab-55ac-46ac-bcad-9c33ea5c79c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:30.999239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:31.000263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:31.001390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:31.001390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:31.001390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:31.001390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:31.001390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:31.001390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:31.001390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:31.001390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:31.001390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 410/818] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:31.001390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d322ab-55ac-46ac-bcad-9c33ea5c79c1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:31.020704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2504628-31ee-4be7-87b9-d8532a945eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:31.021339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504628-31ee-4be7-87b9-d8532a945eff None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:31.021613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504628-31ee-4be7-87b9-d8532a945eff None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:31.021878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504628-31ee-4be7-87b9-d8532a945eff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:31.022576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2504628-31ee-4be7-87b9-d8532a945eff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:31.023925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2504628-31ee-4be7-87b9-d8532a945eff None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:31.025766 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:31.098094 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d322ab-55ac-46ac-bcad-9c33ea5c79c1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:31.131383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3ac91-4f38-4227-a18e-61aa28d54cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:31.132012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ac91-4f38-4227-a18e-61aa28d54cae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:31.132291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ac91-4f38-4227-a18e-61aa28d54cae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:31.132564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ac91-4f38-4227-a18e-61aa28d54cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:31.142420 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3ac91-4f38-4227-a18e-61aa28d54cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:31.143655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 409/819] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:20:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:31.143986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3ac91-4f38-4227-a18e-61aa28d54cae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:31.144550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2504628-31ee-4be7-87b9-d8532a945eff None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:31.169467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2eb3ac91-4f38-4227-a18e-61aa28d54cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:31.175484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:31.177075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:31.184363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:31.184363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:31.184363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:31.184363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:31.184363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 411/820] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:31.184363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3ac91-4f38-4227-a18e-61aa28d54cae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:31.266704 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:31.278745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2504628-31ee-4be7-87b9-d8532a945eff None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:31.292583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3ac91-4f38-4227-a18e-61aa28d54cae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:31.322207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf6a5e-f1d0-4885-9f0e-70e24db9ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:31.324018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf6a5e-f1d0-4885-9f0e-70e24db9ff6c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:31.324018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf6a5e-f1d0-4885-9f0e-70e24db9ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:31.324018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf6a5e-f1d0-4885-9f0e-70e24db9ff6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:31.331748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf6a5e-f1d0-4885-9f0e-70e24db9ff6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:31.331894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d373f7c-36d9-447b-8d75-60f15620e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:31.332437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d373f7c-36d9-447b-8d75-60f15620e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:31.332716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d373f7c-36d9-447b-8d75-60f15620e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:31.332987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d373f7c-36d9-447b-8d75-60f15620e1f2 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:31.333258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf6a5e-f1d0-4885-9f0e-70e24db9ff6c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:31.333736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d373f7c-36d9-447b-8d75-60f15620e1f2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:31.334034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d373f7c-36d9-447b-8d75-60f15620e1f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:31.335422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d373f7c-36d9-447b-8d75-60f15620e1f2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:31.340299 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 412/821] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:31.341075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d373f7c-36d9-447b-8d75-60f15620e1f2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7daf6a5e-f1d0-4885-9f0e-70e24db9ff6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:31.349913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:31.350865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:31.351773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:31.351773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:31.351773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:31.351773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:31.351773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:31.351773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:31.351773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:31.351773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:31.351773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 410/822] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:31.352818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf6a5e-f1d0-4885-9f0e-70e24db9ff6c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:31.428343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:31.449865 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d373f7c-36d9-447b-8d75-60f15620e1f2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:31.459554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf6a5e-f1d0-4885-9f0e-70e24db9ff6c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:31.485362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded3415-6ac1-48ef-8d45-6330a4295680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:31.485989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded3415-6ac1-48ef-8d45-6330a4295680 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:31.486268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded3415-6ac1-48ef-8d45-6330a4295680 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:31.486543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded3415-6ac1-48ef-8d45-6330a4295680 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:31.487297 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded3415-6ac1-48ef-8d45-6330a4295680 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:31.487605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded3415-6ac1-48ef-8d45-6330a4295680 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:31.489034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded3415-6ac1-48ef-8d45-6330a4295680 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:31.496866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5977f-d4bb-4a8b-9bcd-80263d48f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:31.497508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5977f-d4bb-4a8b-9bcd-80263d48f5dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:31.497783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5977f-d4bb-4a8b-9bcd-80263d48f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:31.498047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5977f-d4bb-4a8b-9bcd-80263d48f5dc None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:31.498725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5977f-d4bb-4a8b-9bcd-80263d48f5dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:31.499022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5977f-d4bb-4a8b-9bcd-80263d48f5dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:31.499717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:31.500368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5977f-d4bb-4a8b-9bcd-80263d48f5dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:31.503158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 413/823] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:31.504255 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded3415-6ac1-48ef-8d45-6330a4295680 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:31.519251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 411/824] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:31.519251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5977f-d4bb-4a8b-9bcd-80263d48f5dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:31.621909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5977f-d4bb-4a8b-9bcd-80263d48f5dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:31.622540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded3415-6ac1-48ef-8d45-6330a4295680 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:31.652574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:31.657694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460c3f6-3ced-4d72-a7e7-973926cb8fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:31.658315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460c3f6-3ced-4d72-a7e7-973926cb8fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:31.658594 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460c3f6-3ced-4d72-a7e7-973926cb8fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:31.658891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460c3f6-3ced-4d72-a7e7-973926cb8fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:31.659607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460c3f6-3ced-4d72-a7e7-973926cb8fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:31.659941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460c3f6-3ced-4d72-a7e7-973926cb8fd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:31.660057 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aa85c-415e-46a6-82b0-61649df6f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:31.660598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aa85c-415e-46a6-82b0-61649df6f234 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:31.660871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aa85c-415e-46a6-82b0-61649df6f234 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:31.661152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aa85c-415e-46a6-82b0-61649df6f234 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:31.661365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460c3f6-3ced-4d72-a7e7-973926cb8fd8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:31.664076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4aa85c-415e-46a6-82b0-61649df6f234 None admin] RBAC: Adding query filter params (type=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:31.664076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4aa85c-415e-46a6-82b0-61649df6f234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:31.664076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4aa85c-415e-46a6-82b0-61649df6f234 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:31.669008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 414/825] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:31.669803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aa85c-415e-46a6-82b0-61649df6f234 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:31.678620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 412/826] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:31.679403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460c3f6-3ced-4d72-a7e7-973926cb8fd8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:31.736126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:31.781894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aa85c-415e-46a6-82b0-61649df6f234 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:31.790421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460c3f6-3ced-4d72-a7e7-973926cb8fd8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:31.822481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff005fa-07ee-4a48-b204-f52970be5e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:31.823217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff005fa-07ee-4a48-b204-f52970be5e2a None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:31.823506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff005fa-07ee-4a48-b204-f52970be5e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:31.823840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff005fa-07ee-4a48-b204-f52970be5e2a None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/ef24fa7356ac455b8994e0e6d1959654/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:31.825741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff005fa-07ee-4a48-b204-f52970be5e2a None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=ef24fa7356ac455b8994e0e6d1959654, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:31.826699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27bcbe-9919-48ed-b3c8-a3cf99dcc4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:31.827175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff005fa-07ee-4a48-b204-f52970be5e2a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:31.827346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27bcbe-9919-48ed-b3c8-a3cf99dcc4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:31.827647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27bcbe-9919-48ed-b3c8-a3cf99dcc4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:31.827917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27bcbe-9919-48ed-b3c8-a3cf99dcc4c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:31.834693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27bcbe-9919-48ed-b3c8-a3cf99dcc4c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:31.836146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27bcbe-9919-48ed-b3c8-a3cf99dcc4c1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7d27bcbe-9919-48ed-b3c8-a3cf99dcc4c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:31.848879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:31.850141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:31.851272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:31.851272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:31.851272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:31.851272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:31.851272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:31.851272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:31.851272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:31.851272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:31.851272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 413/827] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:31.851272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27bcbe-9919-48ed-b3c8-a3cf99dcc4c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:31.881175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 415/828] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:20:31 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/ef24fa7356ac455b8994e0e6d1959654/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:20:31.881175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff005fa-07ee-4a48-b204-f52970be5e2a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:31.923329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:31.984360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27bcbe-9919-48ed-b3c8-a3cf99dcc4c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:32.022179 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff005fa-07ee-4a48-b204-f52970be5e2a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:32.033911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7369188-f920-4248-a99a-c352eb60608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:32.034404 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7369188-f920-4248-a99a-c352eb60608a None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:32.034686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7369188-f920-4248-a99a-c352eb60608a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:32.034955 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7369188-f920-4248-a99a-c352eb60608a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:32.035671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7369188-f920-4248-a99a-c352eb60608a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:32.037044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7369188-f920-4248-a99a-c352eb60608a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:32.051957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:32.065068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fae945-469d-426c-9adc-c5c455eb6b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:32.065718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fae945-469d-426c-9adc-c5c455eb6b5f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:32.065995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fae945-469d-426c-9adc-c5c455eb6b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:32.066266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fae945-469d-426c-9adc-c5c455eb6b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:32.067225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fae945-469d-426c-9adc-c5c455eb6b5f None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=531ebc9dee0440888b94a6bf17d7a335) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:32.067535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fae945-469d-426c-9adc-c5c455eb6b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:32.068961 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fae945-469d-426c-9adc-c5c455eb6b5f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:32.075363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 416/829] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:31 2022] GET /identity/v3/role_assignments?user.id=531ebc9dee0440888b94a6bf17d7a335&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=57a86ff4c9de433399662eebf6893065 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:32.075991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fae945-469d-426c-9adc-c5c455eb6b5f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:32.121989 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 414/830] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:20:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:32.210404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fae945-469d-426c-9adc-c5c455eb6b5f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:32.263819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e692f0a-a84e-4c73-88cf-331a4da72d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:32.264467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692f0a-a84e-4c73-88cf-331a4da72d8c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:32.264751 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692f0a-a84e-4c73-88cf-331a4da72d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:32.265031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692f0a-a84e-4c73-88cf-331a4da72d8c None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:32.265866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e692f0a-a84e-4c73-88cf-331a4da72d8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:32.266174 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e692f0a-a84e-4c73-88cf-331a4da72d8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:32.267807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e692f0a-a84e-4c73-88cf-331a4da72d8c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:32.287327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 417/831] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:32.294488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7369188-f920-4248-a99a-c352eb60608a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:32.410519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7369188-f920-4248-a99a-c352eb60608a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:32.421720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:32.448618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb97382-23fe-4ac2-91e7-86cbd272a6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:32.449324 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97382-23fe-4ac2-91e7-86cbd272a6bf None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:32.449607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97382-23fe-4ac2-91e7-86cbd272a6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:32.449881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97382-23fe-4ac2-91e7-86cbd272a6bf None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/c8577537a1a84cffb5d8aebc4f41e8e0/roles/32be7893438b4f25a422f68ef7c24fef` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:32.465632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb97382-23fe-4ac2-91e7-86cbd272a6bf None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=c8577537a1a84cffb5d8aebc4f41e8e0, role_id=32be7893438b4f25a422f68ef7c24fef)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:32.467098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb97382-23fe-4ac2-91e7-86cbd272a6bf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:32.567167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 415/832] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:20:32 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/c8577537a1a84cffb5d8aebc4f41e8e0/roles/32be7893438b4f25a422f68ef7c24fef => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:20:33.225653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87803-1728-43ef-967e-24caacb6a9fd None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:33.226201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87803-1728-43ef-967e-24caacb6a9fd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:33.226201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87803-1728-43ef-967e-24caacb6a9fd None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:33.228401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 418/833] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:33.233578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2046e-529c-4af2-894b-ed2d7b3ccad6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:33.233977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2046e-529c-4af2-894b-ed2d7b3ccad6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:33.234123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2046e-529c-4af2-894b-ed2d7b3ccad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:33.252021 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e9d2046e-529c-4af2-894b-ed2d7b3ccad6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:33.253209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e9d2046e-529c-4af2-894b-ed2d7b3ccad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:33.325793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 416/834] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:33.346481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d87803-1728-43ef-967e-24caacb6a9fd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:33.395706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:33.454903 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d87803-1728-43ef-967e-24caacb6a9fd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:33.490511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ca044-0dcd-42a6-a82b-5397592193b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:33.491160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ca044-0dcd-42a6-a82b-5397592193b1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:33.491438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ca044-0dcd-42a6-a82b-5397592193b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:33.491713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ca044-0dcd-42a6-a82b-5397592193b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:33.492340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ca044-0dcd-42a6-a82b-5397592193b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:33.494379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ca044-0dcd-42a6-a82b-5397592193b1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-504ca044-0dcd-42a6-a82b-5397592193b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:33.505857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:33.511293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:33.512171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 419/835] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:20:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:33.513435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2046e-529c-4af2-894b-ed2d7b3ccad6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:33.603218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:33.615316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2046e-529c-4af2-894b-ed2d7b3ccad6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:33.651618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dde414-472c-49fd-969f-c17554ba494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:33.652234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dde414-472c-49fd-969f-c17554ba494e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:33.652517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dde414-472c-49fd-969f-c17554ba494e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:33.652788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dde414-472c-49fd-969f-c17554ba494e None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:33.653499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dde414-472c-49fd-969f-c17554ba494e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:33.653803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dde414-472c-49fd-969f-c17554ba494e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:33.655243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dde414-472c-49fd-969f-c17554ba494e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:33.660104 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 417/836] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:20:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:33.666163 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ca044-0dcd-42a6-a82b-5397592193b1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:33.775295 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ca044-0dcd-42a6-a82b-5397592193b1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:33.785258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:33.811208 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bba2a2-3796-40d0-9169-f6fa6a63fcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:33.812123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bba2a2-3796-40d0-9169-f6fa6a63fcfe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:33.812622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bba2a2-3796-40d0-9169-f6fa6a63fcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:33.813072 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bba2a2-3796-40d0-9169-f6fa6a63fcfe None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:33.814070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bba2a2-3796-40d0-9169-f6fa6a63fcfe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:33.814553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bba2a2-3796-40d0-9169-f6fa6a63fcfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:33.816088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bba2a2-3796-40d0-9169-f6fa6a63fcfe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:33.822063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 420/837] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:20:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:34.089880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e93fe-f4c5-464f-a3d0-609cf8e26b41 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:34.090164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e93fe-f4c5-464f-a3d0-609cf8e26b41 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:34.090442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e93fe-f4c5-464f-a3d0-609cf8e26b41 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:34.092181 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 418/838] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:34.097600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef0f2b-a835-4e62-8693-6291e36810ff None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:34.097989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef0f2b-a835-4e62-8693-6291e36810ff None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:34.098336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef0f2b-a835-4e62-8693-6291e36810ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:34.117246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eeef0f2b-a835-4e62-8693-6291e36810ff None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:34.119036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eeef0f2b-a835-4e62-8693-6291e36810ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:34.194526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 421/839] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:34.217969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e93fe-f4c5-464f-a3d0-609cf8e26b41 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:34.324427 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e93fe-f4c5-464f-a3d0-609cf8e26b41 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:34.360476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a64c9f-75a9-4cc5-9121-474c73b7769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:34.361043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64c9f-75a9-4cc5-9121-474c73b7769d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:34.361348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64c9f-75a9-4cc5-9121-474c73b7769d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:34.361672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a64c9f-75a9-4cc5-9121-474c73b7769d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:34.372537 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a64c9f-75a9-4cc5-9121-474c73b7769d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-49a64c9f-75a9-4cc5-9121-474c73b7769d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:34.377535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:34.378676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:20:34.379722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:34.383837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 419/840] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:34.385234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef0f2b-a835-4e62-8693-6291e36810ff None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:34.402984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49e68f-6f51-42f9-aa89-8686f0fdb1f0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:34.402984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49e68f-6f51-42f9-aa89-8686f0fdb1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:34.404777 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49e68f-6f51-42f9-aa89-8686f0fdb1f0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:34.404777 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 420/841] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:34.410123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05fad-57e4-4d7f-9389-4f529bebffb0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:34.410649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05fad-57e4-4d7f-9389-4f529bebffb0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:34.411175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05fad-57e4-4d7f-9389-4f529bebffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:34.430878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8dd05fad-57e4-4d7f-9389-4f529bebffb0 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:34.432075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8dd05fad-57e4-4d7f-9389-4f529bebffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:34.457559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:34.509264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 421/842] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:34.514222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef0f2b-a835-4e62-8693-6291e36810ff None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:34.524425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:34.533680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd05fad-57e4-4d7f-9389-4f529bebffb0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:34.552007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63cbe3-f7bf-4790-9d9e-adb2b7aea498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:34.552745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63cbe3-f7bf-4790-9d9e-adb2b7aea498 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:34.553445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63cbe3-f7bf-4790-9d9e-adb2b7aea498 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:34.553735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63cbe3-f7bf-4790-9d9e-adb2b7aea498 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:34.554923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63cbe3-f7bf-4790-9d9e-adb2b7aea498 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:34.556308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63cbe3-f7bf-4790-9d9e-adb2b7aea498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:34.558439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63cbe3-f7bf-4790-9d9e-adb2b7aea498 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:34.573344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 422/843] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:20:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:34.574548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63cbe3-f7bf-4790-9d9e-adb2b7aea498 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:34.663335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd05fad-57e4-4d7f-9389-4f529bebffb0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:34.688635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63cbe3-f7bf-4790-9d9e-adb2b7aea498 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:34.709638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d90a5c-0091-4ea5-a639-8e1f0bec33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:34.710286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90a5c-0091-4ea5-a639-8e1f0bec33a4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:34.710983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90a5c-0091-4ea5-a639-8e1f0bec33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:34.711816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90a5c-0091-4ea5-a639-8e1f0bec33a4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:34.712601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90a5c-0091-4ea5-a639-8e1f0bec33a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:34.714000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90a5c-0091-4ea5-a639-8e1f0bec33a4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-16d90a5c-0091-4ea5-a639-8e1f0bec33a4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:34.722912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:34.723851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:34.724698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 422/844] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 05:20:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:34.726137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7531f-37d8-4d35-8a0f-2e9bc12f4422 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:34.726137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7531f-37d8-4d35-8a0f-2e9bc12f4422 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:34.726137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7531f-37d8-4d35-8a0f-2e9bc12f4422 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:34.727254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 423/845] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:34.731579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162da4b-8f3f-4407-812c-20e3cd7ff41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:34.731709 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7531f-37d8-4d35-8a0f-2e9bc12f4422 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:34.732237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162da4b-8f3f-4407-812c-20e3cd7ff41c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:34.732524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162da4b-8f3f-4407-812c-20e3cd7ff41c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:34.732798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162da4b-8f3f-4407-812c-20e3cd7ff41c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:34.740478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:34.746468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162da4b-8f3f-4407-812c-20e3cd7ff41c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:34.747943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162da4b-8f3f-4407-812c-20e3cd7ff41c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4162da4b-8f3f-4407-812c-20e3cd7ff41c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:34.762956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:34.764218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:34.765171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:34.765171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:34.765171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:34.765171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:34.765171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 423/846] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:34.765816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423dfac-7acc-4285-bc20-8724121a5be3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:34.766099 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423dfac-7acc-4285-bc20-8724121a5be3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:34.766369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423dfac-7acc-4285-bc20-8724121a5be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:34.784894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0423dfac-7acc-4285-bc20-8724121a5be3 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:34.786127 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0423dfac-7acc-4285-bc20-8724121a5be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:34.798404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:34.846724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7531f-37d8-4d35-8a0f-2e9bc12f4422 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:34.865196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 424/847] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:34.865548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423dfac-7acc-4285-bc20-8724121a5be3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:34.887338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6a49e-9057-4452-99e3-7511d02515d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:34.888143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6a49e-9057-4452-99e3-7511d02515d7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:34.888498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6a49e-9057-4452-99e3-7511d02515d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:34.888840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6a49e-9057-4452-99e3-7511d02515d7 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:34.889938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6a49e-9057-4452-99e3-7511d02515d7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:34.889938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6a49e-9057-4452-99e3-7511d02515d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:34.891692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6a49e-9057-4452-99e3-7511d02515d7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:34.901360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 424/848] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 05:20:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:34.902388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6a49e-9057-4452-99e3-7511d02515d7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:35.000491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:35.013366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423dfac-7acc-4285-bc20-8724121a5be3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:35.033454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6a49e-9057-4452-99e3-7511d02515d7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:35.048184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e145b5f-7ec6-44f9-9cdb-3aadd0af3392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:35.048807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145b5f-7ec6-44f9-9cdb-3aadd0af3392 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:35.049084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145b5f-7ec6-44f9-9cdb-3aadd0af3392 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:35.049373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145b5f-7ec6-44f9-9cdb-3aadd0af3392 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:35.050064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e145b5f-7ec6-44f9-9cdb-3aadd0af3392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:35.050371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e145b5f-7ec6-44f9-9cdb-3aadd0af3392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:35.051978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e145b5f-7ec6-44f9-9cdb-3aadd0af3392 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:35.063856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 425/849] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:35.064636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e145b5f-7ec6-44f9-9cdb-3aadd0af3392 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:35.075203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:35.078472 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089315a9-686e-46ac-92cb-5fa6d75e7b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:35.079421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089315a9-686e-46ac-92cb-5fa6d75e7b8e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:35.079846 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089315a9-686e-46ac-92cb-5fa6d75e7b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:35.080276 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089315a9-686e-46ac-92cb-5fa6d75e7b8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:35.092237 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089315a9-686e-46ac-92cb-5fa6d75e7b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-089315a9-686e-46ac-92cb-5fa6d75e7b8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:35.097234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:35.098182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:35.099063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 425/850] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:20:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:35.099775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089315a9-686e-46ac-92cb-5fa6d75e7b8e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:35.183696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e145b5f-7ec6-44f9-9cdb-3aadd0af3392 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:35.214059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089315a9-686e-46ac-92cb-5fa6d75e7b8e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:35.218542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32348cfc-15e8-406f-b16e-ef0c234e0a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:35.219160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348cfc-15e8-406f-b16e-ef0c234e0a86 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:35.219437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348cfc-15e8-406f-b16e-ef0c234e0a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:35.219708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348cfc-15e8-406f-b16e-ef0c234e0a86 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:35.220382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32348cfc-15e8-406f-b16e-ef0c234e0a86 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:35.220689 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32348cfc-15e8-406f-b16e-ef0c234e0a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:35.222070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32348cfc-15e8-406f-b16e-ef0c234e0a86 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:35.237161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 426/851] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 05:20:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:35.237161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32348cfc-15e8-406f-b16e-ef0c234e0a86 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:35.261681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:35.268060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdafe5-c862-46d5-80ea-4e6278292566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:35.268815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdafe5-c862-46d5-80ea-4e6278292566 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:35.269207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdafe5-c862-46d5-80ea-4e6278292566 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:35.269560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdafe5-c862-46d5-80ea-4e6278292566 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:35.278744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdafe5-c862-46d5-80ea-4e6278292566 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:35.280285 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdafe5-c862-46d5-80ea-4e6278292566 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8cbdafe5-c862-46d5-80ea-4e6278292566 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:35.294372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:35.295421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:35.296461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:35.296461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:35.296461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:35.296461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:35.296461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:35.296461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:35.296461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:35.296461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:35.296461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 05:20:35.296461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:35.296461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 426/852] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:20:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:35.303433 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdafe5-c862-46d5-80ea-4e6278292566 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:35.326740 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:35.370328 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32348cfc-15e8-406f-b16e-ef0c234e0a86 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:35.421258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdafe5-c862-46d5-80ea-4e6278292566 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:35.422356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d9259-071e-449c-886c-11563fd91214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:35.423251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d9259-071e-449c-886c-11563fd91214 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:35.423533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d9259-071e-449c-886c-11563fd91214 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:35.424726 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d9259-071e-449c-886c-11563fd91214 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:35.425745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d9259-071e-449c-886c-11563fd91214 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:35.426055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d9259-071e-449c-886c-11563fd91214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:35.427429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d9259-071e-449c-886c-11563fd91214 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:35.438529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 427/853] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:35.444830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d9259-071e-449c-886c-11563fd91214 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:35.468721 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e7c14-1b3f-4938-a90f-f1c3def5da41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:35.469839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e7c14-1b3f-4938-a90f-f1c3def5da41 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:35.470229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e7c14-1b3f-4938-a90f-f1c3def5da41 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:35.470605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e7c14-1b3f-4938-a90f-f1c3def5da41 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:35.471523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e7c14-1b3f-4938-a90f-f1c3def5da41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:35.471937 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e7c14-1b3f-4938-a90f-f1c3def5da41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:35.474193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e7c14-1b3f-4938-a90f-f1c3def5da41 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:35.495381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 427/854] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 05:20:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:35.502972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e7c14-1b3f-4938-a90f-f1c3def5da41 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:35.566287 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:35.567827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d9259-071e-449c-886c-11563fd91214 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:35.599913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:35.605399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b163a2-3fe6-41b3-a2f2-434582d32330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:35.606133 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b163a2-3fe6-41b3-a2f2-434582d32330 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:35.606519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b163a2-3fe6-41b3-a2f2-434582d32330 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:35.606868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b163a2-3fe6-41b3-a2f2-434582d32330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:35.618456 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b163a2-3fe6-41b3-a2f2-434582d32330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:35.620213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b163a2-3fe6-41b3-a2f2-434582d32330 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:35.635094 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e7c14-1b3f-4938-a90f-f1c3def5da41 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e5b163a2-3fe6-41b3-a2f2-434582d32330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:35.636154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:35.637060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:35.638004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:35.638004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:35.638004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:35.638004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:35.644985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 428/855] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:35.646246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b163a2-3fe6-41b3-a2f2-434582d32330 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:35.685831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f2c11-b152-4f3b-9be7-04a2d132ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:35.686455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2c11-b152-4f3b-9be7-04a2d132ef20 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:35.686736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2c11-b152-4f3b-9be7-04a2d132ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:35.687009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f2c11-b152-4f3b-9be7-04a2d132ef20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:35.780029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f2c11-b152-4f3b-9be7-04a2d132ef20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:35.782562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f2c11-b152-4f3b-9be7-04a2d132ef20 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:35.786604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b163a2-3fe6-41b3-a2f2-434582d32330 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:35.826970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb410c03-cec3-4142-b724-bdaf12c14596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:35.827958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb410c03-cec3-4142-b724-bdaf12c14596 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:35.828438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb410c03-cec3-4142-b724-bdaf12c14596 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:35.829504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb410c03-cec3-4142-b724-bdaf12c14596 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:35.830457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb410c03-cec3-4142-b724-bdaf12c14596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:35.830986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb410c03-cec3-4142-b724-bdaf12c14596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:35.833468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb410c03-cec3-4142-b724-bdaf12c14596 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:35.839933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:35.852651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 429/856] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:35.858842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522793c-3707-447e-87ad-a21863d0578b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:35.859126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522793c-3707-447e-87ad-a21863d0578b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:35.859400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522793c-3707-447e-87ad-a21863d0578b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:35.860683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 430/857] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:35.865015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522793c-3707-447e-87ad-a21863d0578b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:35.907759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 428/858] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:20:35.907759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0a6c4-6198-4350-9d6f-86d324571de7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:35.907759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0a6c4-6198-4350-9d6f-86d324571de7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:35.907759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0a6c4-6198-4350-9d6f-86d324571de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:35.920993 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:35.923955 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-22c0a6c4-6198-4350-9d6f-86d324571de7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:35.925170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-22c0a6c4-6198-4350-9d6f-86d324571de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:35.980810 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522793c-3707-447e-87ad-a21863d0578b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:36.001264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 429/859] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:36.001264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0a6c4-6198-4350-9d6f-86d324571de7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:36.023627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ab389-153d-49d5-a4ad-cda83bb63193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:36.024797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ab389-153d-49d5-a4ad-cda83bb63193 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:36.025076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ab389-153d-49d5-a4ad-cda83bb63193 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:36.025639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ab389-153d-49d5-a4ad-cda83bb63193 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:36.032776 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ab389-153d-49d5-a4ad-cda83bb63193 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:36.034267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ab389-153d-49d5-a4ad-cda83bb63193 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-644ab389-153d-49d5-a4ad-cda83bb63193 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:36.046799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:36.047791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 431/860] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 05:20:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:36.048738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ab389-153d-49d5-a4ad-cda83bb63193 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:36.091791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:36.116129 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0a6c4-6198-4350-9d6f-86d324571de7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:36.154823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d353823-bbe9-4960-b6d1-dc1ba5bf30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:36.155460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d353823-bbe9-4960-b6d1-dc1ba5bf30f8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:36.155737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d353823-bbe9-4960-b6d1-dc1ba5bf30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:36.156007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d353823-bbe9-4960-b6d1-dc1ba5bf30f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:36.158934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ab389-153d-49d5-a4ad-cda83bb63193 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:36.161901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:36.168940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d353823-bbe9-4960-b6d1-dc1ba5bf30f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:36.170782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d353823-bbe9-4960-b6d1-dc1ba5bf30f8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1d353823-bbe9-4960-b6d1-dc1ba5bf30f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:36.186749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:36.187836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:36.188761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:36.188761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:36.188761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:36.188761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:36.188761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 430/861] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:36.189196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d353823-bbe9-4960-b6d1-dc1ba5bf30f8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:36.207324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cffa3-019f-4c36-a230-a680f3eb71f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:36.208157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cffa3-019f-4c36-a230-a680f3eb71f9 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:36.208743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cffa3-019f-4c36-a230-a680f3eb71f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:36.209463 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cffa3-019f-4c36-a230-a680f3eb71f9 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:36.210306 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cffa3-019f-4c36-a230-a680f3eb71f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:36.212273 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cffa3-019f-4c36-a230-a680f3eb71f9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:36.288271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d353823-bbe9-4960-b6d1-dc1ba5bf30f8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:36.297500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 432/862] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:20:36 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:36.298324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cffa3-019f-4c36-a230-a680f3eb71f9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:36.335512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:36.354497 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a85f8-46b3-45e0-9c47-96c0423f84c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:36.355509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a85f8-46b3-45e0-9c47-96c0423f84c9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:36.355996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a85f8-46b3-45e0-9c47-96c0423f84c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:36.356577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a85f8-46b3-45e0-9c47-96c0423f84c9 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:36.357732 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a85f8-46b3-45e0-9c47-96c0423f84c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:36.359001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a85f8-46b3-45e0-9c47-96c0423f84c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:36.361378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a85f8-46b3-45e0-9c47-96c0423f84c9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:36.394012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 431/863] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 05:20:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:36.396101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a85f8-46b3-45e0-9c47-96c0423f84c9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:36.446601 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cffa3-019f-4c36-a230-a680f3eb71f9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:36.494724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b5cf3-1244-46e5-9908-d23ddec7fa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:36.495369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b5cf3-1244-46e5-9908-d23ddec7fa91 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:36.495650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b5cf3-1244-46e5-9908-d23ddec7fa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:36.495927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b5cf3-1244-46e5-9908-d23ddec7fa91 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:36.497418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b5cf3-1244-46e5-9908-d23ddec7fa91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:36.497726 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b5cf3-1244-46e5-9908-d23ddec7fa91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:36.499122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b5cf3-1244-46e5-9908-d23ddec7fa91 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:36.519833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 433/864] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:36.527330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b5cf3-1244-46e5-9908-d23ddec7fa91 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:36.533251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a85f8-46b3-45e0-9c47-96c0423f84c9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:36.565555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:36.571192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c6ea4-16ab-461c-ae8e-fd1d0711abca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:36.572261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6ea4-16ab-461c-ae8e-fd1d0711abca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:36.572261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6ea4-16ab-461c-ae8e-fd1d0711abca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:36.572465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6ea4-16ab-461c-ae8e-fd1d0711abca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:36.642274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:36.660035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c6ea4-16ab-461c-ae8e-fd1d0711abca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:36.662174 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c6ea4-16ab-461c-ae8e-fd1d0711abca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:36.662699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b5cf3-1244-46e5-9908-d23ddec7fa91 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:36.724823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868819-d576-4e20-8c7f-e8b28500c950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:36.725675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868819-d576-4e20-8c7f-e8b28500c950 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:36.725963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868819-d576-4e20-8c7f-e8b28500c950 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:36.726236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868819-d576-4e20-8c7f-e8b28500c950 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:36.738878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00868819-d576-4e20-8c7f-e8b28500c950 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:36.740821 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00868819-d576-4e20-8c7f-e8b28500c950 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-00868819-d576-4e20-8c7f-e8b28500c950 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:36.759377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:36.760344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:36.761289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:36.761289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:36.761289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:36.761289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:36.761289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:36.761289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:36.761289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:36.761289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:36.761289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 434/865] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:36.767846 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868819-d576-4e20-8c7f-e8b28500c950 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:36.797021 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 432/866] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:36 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:20:36.802790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c6ea4-16ab-461c-ae8e-fd1d0711abca None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:36.881525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:36.891157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868819-d576-4e20-8c7f-e8b28500c950 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:36.907854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:36.910782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c6ea4-16ab-461c-ae8e-fd1d0711abca None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:36.929433 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eb181-bc0f-4748-849b-db5fb61ca1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:36.936263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eb181-bc0f-4748-849b-db5fb61ca1ae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:36.936263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eb181-bc0f-4748-849b-db5fb61ca1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:36.936263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eb181-bc0f-4748-849b-db5fb61ca1ae None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:36.936263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3eb181-bc0f-4748-849b-db5fb61ca1ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:36.936263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3eb181-bc0f-4748-849b-db5fb61ca1ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:36.936263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3eb181-bc0f-4748-849b-db5fb61ca1ae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:36.954417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317817c-f1ec-40bd-b052-dd953a894806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:36.954623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 435/867] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:36.955565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eb181-bc0f-4748-849b-db5fb61ca1ae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:36.956600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317817c-f1ec-40bd-b052-dd953a894806 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:36.956876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317817c-f1ec-40bd-b052-dd953a894806 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:36.957159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317817c-f1ec-40bd-b052-dd953a894806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:36.969993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317817c-f1ec-40bd-b052-dd953a894806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:36.971625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317817c-f1ec-40bd-b052-dd953a894806 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9317817c-f1ec-40bd-b052-dd953a894806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:36.989058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:36.990097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:36.991013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:36.991013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:36.991013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:36.991013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:36.995736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 433/868] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:36.996806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317817c-f1ec-40bd-b052-dd953a894806 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:37.110491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eb181-bc0f-4748-849b-db5fb61ca1ae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:37.115463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317817c-f1ec-40bd-b052-dd953a894806 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:37.154706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1240f-1243-4959-95a9-b7e94ca09431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:37.155694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1240f-1243-4959-95a9-b7e94ca09431 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:37.156190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1240f-1243-4959-95a9-b7e94ca09431 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:37.156655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1240f-1243-4959-95a9-b7e94ca09431 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:37.158695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1240f-1243-4959-95a9-b7e94ca09431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:37.159706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1240f-1243-4959-95a9-b7e94ca09431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:37.161619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1240f-1243-4959-95a9-b7e94ca09431 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:37.165429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:37.169613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49042f56-8c56-4f01-ab23-01601fba7649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:37.176933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49042f56-8c56-4f01-ab23-01601fba7649 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:37.176933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49042f56-8c56-4f01-ab23-01601fba7649 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:37.176933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49042f56-8c56-4f01-ab23-01601fba7649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:37.176933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49042f56-8c56-4f01-ab23-01601fba7649 None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=ef24fa7356ac455b8994e0e6d1959654) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:37.176933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49042f56-8c56-4f01-ab23-01601fba7649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:37.176933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49042f56-8c56-4f01-ab23-01601fba7649 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:37.181529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 436/869] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:36 2022] GET /identity/v3/role_assignments?user.id=ef24fa7356ac455b8994e0e6d1959654&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=57a86ff4c9de433399662eebf6893065 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:37.185539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 434/870] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:37.191537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49042f56-8c56-4f01-ab23-01601fba7649 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:37.210269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:37.318846 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49042f56-8c56-4f01-ab23-01601fba7649 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:37.359376 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf86d5-37ab-48b1-8b85-beb7a8fa1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:37.360451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf86d5-37ab-48b1-8b85-beb7a8fa1441 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:37.360941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf86d5-37ab-48b1-8b85-beb7a8fa1441 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:37.361448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf86d5-37ab-48b1-8b85-beb7a8fa1441 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:37.370357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf86d5-37ab-48b1-8b85-beb7a8fa1441 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:37.372192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf86d5-37ab-48b1-8b85-beb7a8fa1441 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ddcf86d5-37ab-48b1-8b85-beb7a8fa1441 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:37.386335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:37.387552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:37.388476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:37.388476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:37.388476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:37.388476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:37.388476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:37.388476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:37.388476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:37.388476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:37.391032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 437/871] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:37.396935 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1240f-1243-4959-95a9-b7e94ca09431 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:37.525479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1240f-1243-4959-95a9-b7e94ca09431 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:37.566348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b211c-9221-4b35-bcdd-c0a18f1a91c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:37.567823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b211c-9221-4b35-bcdd-c0a18f1a91c7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:37.568308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b211c-9221-4b35-bcdd-c0a18f1a91c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:37.568779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b211c-9221-4b35-bcdd-c0a18f1a91c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:37.569883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b211c-9221-4b35-bcdd-c0a18f1a91c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:37.570466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b211c-9221-4b35-bcdd-c0a18f1a91c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:37.572739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b211c-9221-4b35-bcdd-c0a18f1a91c7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:37.582416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb034b-6bf3-45bb-b299-c6d3f533b0bc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:37.583395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb034b-6bf3-45bb-b299-c6d3f533b0bc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:37.583780 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb034b-6bf3-45bb-b299-c6d3f533b0bc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:37.585567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 438/872] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:37.587162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 435/873] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:37.590977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e588145-4110-444a-9017-d74e475a6249 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:37.591317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e588145-4110-444a-9017-d74e475a6249 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:37.591699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e588145-4110-444a-9017-d74e475a6249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:37.593645 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b211c-9221-4b35-bcdd-c0a18f1a91c7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:37.610926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4e588145-4110-444a-9017-d74e475a6249 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:37.612385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4e588145-4110-444a-9017-d74e475a6249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:37.666508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:37.692290 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:37.705389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 439/874] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:37.719657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b211c-9221-4b35-bcdd-c0a18f1a91c7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:37.720808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e588145-4110-444a-9017-d74e475a6249 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:37.764819 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0248e8-b090-4160-9149-de9224b4ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:37.765463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0248e8-b090-4160-9149-de9224b4ae15 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:37.765740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0248e8-b090-4160-9149-de9224b4ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:37.766007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0248e8-b090-4160-9149-de9224b4ae15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:37.766792 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0248e8-b090-4160-9149-de9224b4ae15 None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=c8577537a1a84cffb5d8aebc4f41e8e0) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:37.767096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0248e8-b090-4160-9149-de9224b4ae15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:37.768745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0248e8-b090-4160-9149-de9224b4ae15 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:37.775964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 436/875] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:37 2022] GET /identity/v3/role_assignments?user.id=c8577537a1a84cffb5d8aebc4f41e8e0&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:37.857981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e588145-4110-444a-9017-d74e475a6249 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:37.899534 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73451635-7c28-40e0-bfd0-27383878c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:37.900185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73451635-7c28-40e0-bfd0-27383878c614 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:37.900516 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73451635-7c28-40e0-bfd0-27383878c614 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:37.900794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73451635-7c28-40e0-bfd0-27383878c614 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:37.901563 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73451635-7c28-40e0-bfd0-27383878c614 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:37.902957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73451635-7c28-40e0-bfd0-27383878c614 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:38.006926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 440/876] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:20:37 2022] POST /identity/v3/services => generated 269 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:38.518674 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76ebf1-9d68-4b1f-9853-b2fa569a606d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:38.518871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76ebf1-9d68-4b1f-9853-b2fa569a606d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:38.519132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76ebf1-9d68-4b1f-9853-b2fa569a606d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:38.520740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 437/877] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:38.526205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa70bc-7920-4043-8d4c-ff1bce96aed6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:38.526497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa70bc-7920-4043-8d4c-ff1bce96aed6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:38.526775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa70bc-7920-4043-8d4c-ff1bce96aed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:38.545567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8aaa70bc-7920-4043-8d4c-ff1bce96aed6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:38.546755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8aaa70bc-7920-4043-8d4c-ff1bce96aed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:38.602172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:38.622681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 441/878] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:38.645564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76ebf1-9d68-4b1f-9853-b2fa569a606d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:38.758558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76ebf1-9d68-4b1f-9853-b2fa569a606d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:38.779776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:38.794278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c680e-819f-41a9-a840-0470ade12a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:38.794926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c680e-819f-41a9-a840-0470ade12a36 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:38.795207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c680e-819f-41a9-a840-0470ade12a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:38.795478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c680e-819f-41a9-a840-0470ade12a36 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:38.796112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c680e-819f-41a9-a840-0470ade12a36 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:38.797509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c680e-819f-41a9-a840-0470ade12a36 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2a0c680e-819f-41a9-a840-0470ade12a36 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:38.806868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:38.809070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:38.811046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 438/879] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:20:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:38.817150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa70bc-7920-4043-8d4c-ff1bce96aed6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:38.917855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa70bc-7920-4043-8d4c-ff1bce96aed6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:38.955101 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1567c-1439-432b-9472-170d16a0349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:38.955733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1567c-1439-432b-9472-170d16a0349c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:38.956015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1567c-1439-432b-9472-170d16a0349c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:38.956291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1567c-1439-432b-9472-170d16a0349c None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:38.956973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1567c-1439-432b-9472-170d16a0349c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:38.957302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1567c-1439-432b-9472-170d16a0349c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:38.958668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1567c-1439-432b-9472-170d16a0349c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:38.965748 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 442/880] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:20:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:38.971062 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c680e-819f-41a9-a840-0470ade12a36 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:39.084061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c680e-819f-41a9-a840-0470ade12a36 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:39.124596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f014-dc0d-4d12-927f-979ce11c17f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:39.125245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f014-dc0d-4d12-927f-979ce11c17f6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:39.125530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f014-dc0d-4d12-927f-979ce11c17f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:39.125864 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f014-dc0d-4d12-927f-979ce11c17f6 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:39.126557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97f014-dc0d-4d12-927f-979ce11c17f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:39.126860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97f014-dc0d-4d12-927f-979ce11c17f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:39.128238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97f014-dc0d-4d12-927f-979ce11c17f6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:39.134416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 439/881] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:20:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:39.139908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1567c-1439-432b-9472-170d16a0349c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:39.213501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:39.255515 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1567c-1439-432b-9472-170d16a0349c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:39.290819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9cbaa-9fee-40f3-871c-2b059102ad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:39.291449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9cbaa-9fee-40f3-871c-2b059102ad1f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:39.291738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9cbaa-9fee-40f3-871c-2b059102ad1f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:39.292015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9cbaa-9fee-40f3-871c-2b059102ad1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:39.292774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9cbaa-9fee-40f3-871c-2b059102ad1f None admin] RBAC: Adding query filter params (interface=public, service_id=a189f0f918c84489bbfd6e27148981ba, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:39.293088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9cbaa-9fee-40f3-871c-2b059102ad1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:39.294476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9cbaa-9fee-40f3-871c-2b059102ad1f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:39.300087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 443/882] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 05:20:39 2022] GET /identity/v3/endpoints?service_id=a189f0f918c84489bbfd6e27148981ba&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:39.306511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f014-dc0d-4d12-927f-979ce11c17f6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:39.358146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:39.415583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f014-dc0d-4d12-927f-979ce11c17f6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:39.447573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61499d4-98bc-4538-b418-d88931e24e6d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:39.447870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61499d4-98bc-4538-b418-d88931e24e6d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:39.448132 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61499d4-98bc-4538-b418-d88931e24e6d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:39.449663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 444/883] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:39.455028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0bbd1-8ceb-44d8-b9bf-13ac785397c6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:39.455506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921b718-57d1-4c61-bf62-b57a1040846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:39.455921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0bbd1-8ceb-44d8-b9bf-13ac785397c6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:39.456110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921b718-57d1-4c61-bf62-b57a1040846a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:39.456355 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921b718-57d1-4c61-bf62-b57a1040846a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:39.456626 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921b718-57d1-4c61-bf62-b57a1040846a None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:39.456976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0bbd1-8ceb-44d8-b9bf-13ac785397c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:39.457399 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921b718-57d1-4c61-bf62-b57a1040846a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:39.458684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921b718-57d1-4c61-bf62-b57a1040846a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:39.466760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 440/884] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 05:20:39 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:20:39.479417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1dd0bbd1-8ceb-44d8-b9bf-13ac785397c6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:39.480976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1dd0bbd1-8ceb-44d8-b9bf-13ac785397c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:39.562117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 445/885] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:39.584592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921b718-57d1-4c61-bf62-b57a1040846a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:39.694456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921b718-57d1-4c61-bf62-b57a1040846a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:39.708073 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:39.731108 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1449c6-e498-4f24-a141-65019861a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:39.731755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1449c6-e498-4f24-a141-65019861a184 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:39.732027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1449c6-e498-4f24-a141-65019861a184 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:39.732299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1449c6-e498-4f24-a141-65019861a184 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:39.732929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1449c6-e498-4f24-a141-65019861a184 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:39.734337 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1449c6-e498-4f24-a141-65019861a184 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ee1449c6-e498-4f24-a141-65019861a184 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:39.744498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:39.745603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:39.746671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 441/886] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 05:20:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:39.756646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0bbd1-8ceb-44d8-b9bf-13ac785397c6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:39.799593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:39.863048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0bbd1-8ceb-44d8-b9bf-13ac785397c6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:39.905874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16058b-264e-445f-af23-21ed0d71ae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:39.906936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16058b-264e-445f-af23-21ed0d71ae38 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:39.907446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16058b-264e-445f-af23-21ed0d71ae38 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:39.907959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16058b-264e-445f-af23-21ed0d71ae38 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:39.909246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16058b-264e-445f-af23-21ed0d71ae38 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:39.909817 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16058b-264e-445f-af23-21ed0d71ae38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:39.912412 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16058b-264e-445f-af23-21ed0d71ae38 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:39.920618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 446/887] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 05:20:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:39.927453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1449c6-e498-4f24-a141-65019861a184 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:40.034830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1449c6-e498-4f24-a141-65019861a184 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:40.063931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582a162-3919-46cb-a717-eadc212e846b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.064160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582a162-3919-46cb-a717-eadc212e846b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.064393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582a162-3919-46cb-a717-eadc212e846b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.065977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 447/888] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:40.071269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310faf35-9e84-4074-ba73-e5ec3107ec72 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.071552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310faf35-9e84-4074-ba73-e5ec3107ec72 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.071811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310faf35-9e84-4074-ba73-e5ec3107ec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.079300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bffd4b-366a-49fe-bb6d-b34c6667f0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:40.079917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bffd4b-366a-49fe-bb6d-b34c6667f0be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.080197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bffd4b-366a-49fe-bb6d-b34c6667f0be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.080465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bffd4b-366a-49fe-bb6d-b34c6667f0be None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.081160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bffd4b-366a-49fe-bb6d-b34c6667f0be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:40.081466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bffd4b-366a-49fe-bb6d-b34c6667f0be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:40.082830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bffd4b-366a-49fe-bb6d-b34c6667f0be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:40.093236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 442/889] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 05:20:39 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:40.094578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-310faf35-9e84-4074-ba73-e5ec3107ec72 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:40.096030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-310faf35-9e84-4074-ba73-e5ec3107ec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:40.108985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606240-6f67-400c-9db7-b37a99b31464 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.109387 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606240-6f67-400c-9db7-b37a99b31464 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.109597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606240-6f67-400c-9db7-b37a99b31464 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.116699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 443/890] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:40.119475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f660dfa-b76c-4a52-90f7-38a603ccad02 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.119758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f660dfa-b76c-4a52-90f7-38a603ccad02 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.120034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f660dfa-b76c-4a52-90f7-38a603ccad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.142873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3f660dfa-b76c-4a52-90f7-38a603ccad02 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:40.145339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3f660dfa-b76c-4a52-90f7-38a603ccad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:40.189645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 448/891] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:40.194023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:40.209543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310faf35-9e84-4074-ba73-e5ec3107ec72 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:40.237160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 444/892] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:40.255354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f660dfa-b76c-4a52-90f7-38a603ccad02 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:40.260245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:40.335764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310faf35-9e84-4074-ba73-e5ec3107ec72 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:40.379418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f99d4-af5b-4aef-887e-71a2bd24db52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:40.380334 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f99d4-af5b-4aef-887e-71a2bd24db52 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.380617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f99d4-af5b-4aef-887e-71a2bd24db52 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.380892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f99d4-af5b-4aef-887e-71a2bd24db52 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.381564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f99d4-af5b-4aef-887e-71a2bd24db52 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:40.381875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f660dfa-b76c-4a52-90f7-38a603ccad02 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:40.383035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f99d4-af5b-4aef-887e-71a2bd24db52 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3b0f99d4-af5b-4aef-887e-71a2bd24db52 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:40.400539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:40.401554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:20:40.402382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:40.403175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 449/893] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 05:20:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:40.409229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f99d4-af5b-4aef-887e-71a2bd24db52 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:40.422856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bea0c5-051c-475e-9b5c-a4e1ae114f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:40.423732 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea0c5-051c-475e-9b5c-a4e1ae114f58 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.424164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea0c5-051c-475e-9b5c-a4e1ae114f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.424575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bea0c5-051c-475e-9b5c-a4e1ae114f58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.435808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bea0c5-051c-475e-9b5c-a4e1ae114f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c5bea0c5-051c-475e-9b5c-a4e1ae114f58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:40.440977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:40.442143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:20:40.443023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:40.450434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 445/894] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 05:20:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:40.452765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bea0c5-051c-475e-9b5c-a4e1ae114f58 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:40.487557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:40.526961 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:40.530228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f99d4-af5b-4aef-887e-71a2bd24db52 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:40.562604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bea0c5-051c-475e-9b5c-a4e1ae114f58 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:40.567448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce2111-97dc-435d-b333-591773397087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:40.568301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce2111-97dc-435d-b333-591773397087 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.568758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce2111-97dc-435d-b333-591773397087 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.569238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce2111-97dc-435d-b333-591773397087 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.570167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce2111-97dc-435d-b333-591773397087 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:40.570851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce2111-97dc-435d-b333-591773397087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:40.572559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce2111-97dc-435d-b333-591773397087 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:40.581493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 450/895] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 05:20:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:40.584019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce2111-97dc-435d-b333-591773397087 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:40.600327 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1716f-14b1-42bb-9d50-d2c2b8b6d17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:40.600979 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1716f-14b1-42bb-9d50-d2c2b8b6d17d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.601295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1716f-14b1-42bb-9d50-d2c2b8b6d17d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.601650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1716f-14b1-42bb-9d50-d2c2b8b6d17d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.602644 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1716f-14b1-42bb-9d50-d2c2b8b6d17d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:40.602954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1716f-14b1-42bb-9d50-d2c2b8b6d17d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:40.604334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1716f-14b1-42bb-9d50-d2c2b8b6d17d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:40.613568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 446/896] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 05:20:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:40.619674 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1716f-14b1-42bb-9d50-d2c2b8b6d17d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:40.709935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce2111-97dc-435d-b333-591773397087 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:40.730470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:40.740979 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1716f-14b1-42bb-9d50-d2c2b8b6d17d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:40.750306 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7127b-bac8-4044-864c-b4939396d2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:40.751116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7127b-bac8-4044-864c-b4939396d2ac None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.751538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7127b-bac8-4044-864c-b4939396d2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.751987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7127b-bac8-4044-864c-b4939396d2ac None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.752867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7127b-bac8-4044-864c-b4939396d2ac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:40.753389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7127b-bac8-4044-864c-b4939396d2ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:40.754996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7127b-bac8-4044-864c-b4939396d2ac None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:40.763964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 451/897] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 05:20:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:40.769769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7127b-bac8-4044-864c-b4939396d2ac None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:40.786501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640ce5e-a616-4681-9675-e5866f08a13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:40.787464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640ce5e-a616-4681-9675-e5866f08a13c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.787883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640ce5e-a616-4681-9675-e5866f08a13c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.788308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640ce5e-a616-4681-9675-e5866f08a13c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.801029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640ce5e-a616-4681-9675-e5866f08a13c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:40.802929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640ce5e-a616-4681-9675-e5866f08a13c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:40.805974 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a640ce5e-a616-4681-9675-e5866f08a13c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:40.819963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:40.822152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:40.823213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:40.823213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:40.823213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:40.823213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:40.825419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 447/898] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:40.830963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640ce5e-a616-4681-9675-e5866f08a13c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:40.891059 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7127b-bac8-4044-864c-b4939396d2ac None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:40.931041 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002760c-124e-40e0-97ab-b483febb4898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:40.932106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002760c-124e-40e0-97ab-b483febb4898 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:40.932692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002760c-124e-40e0-97ab-b483febb4898 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:40.933220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002760c-124e-40e0-97ab-b483febb4898 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:40.934291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002760c-124e-40e0-97ab-b483febb4898 None admin] RBAC: Adding query filter params (interface=public, service_id=6581296a2ddf439489c25045598874b1, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:40.934910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002760c-124e-40e0-97ab-b483febb4898 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:40.936478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002760c-124e-40e0-97ab-b483febb4898 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:40.942768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 452/899] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 05:20:40 2022] GET /identity/v3/endpoints?service_id=6581296a2ddf439489c25045598874b1&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:40.948669 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002760c-124e-40e0-97ab-b483febb4898 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:40.959371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640ce5e-a616-4681-9675-e5866f08a13c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:41.004790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c78ee9-89ea-44d8-8672-5f47b7a603b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:41.005763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c78ee9-89ea-44d8-8672-5f47b7a603b7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:41.006193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c78ee9-89ea-44d8-8672-5f47b7a603b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:41.006680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c78ee9-89ea-44d8-8672-5f47b7a603b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:41.007558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c78ee9-89ea-44d8-8672-5f47b7a603b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:41.008177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c78ee9-89ea-44d8-8672-5f47b7a603b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:41.009878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c78ee9-89ea-44d8-8672-5f47b7a603b7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:41.023268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 448/900] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:41.028623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c78ee9-89ea-44d8-8672-5f47b7a603b7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:41.032510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:41.062168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:41.071408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002760c-124e-40e0-97ab-b483febb4898 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:41.107006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d9ec3-0614-4f81-98e3-7dc430241611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:41.107636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d9ec3-0614-4f81-98e3-7dc430241611 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:41.107910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d9ec3-0614-4f81-98e3-7dc430241611 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:41.108251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d9ec3-0614-4f81-98e3-7dc430241611 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:41.108830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d9ec3-0614-4f81-98e3-7dc430241611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:41.110227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d9ec3-0614-4f81-98e3-7dc430241611 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:41.122396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 453/901] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 05:20:40 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:20:41.146584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c78ee9-89ea-44d8-8672-5f47b7a603b7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:41.188812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae1fcc-e0b2-4410-bb7e-d625b242e4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:41.189570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1fcc-e0b2-4410-bb7e-d625b242e4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:41.189855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1fcc-e0b2-4410-bb7e-d625b242e4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:41.190130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1fcc-e0b2-4410-bb7e-d625b242e4a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:41.198935 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae1fcc-e0b2-4410-bb7e-d625b242e4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:41.200436 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae1fcc-e0b2-4410-bb7e-d625b242e4a3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-54ae1fcc-e0b2-4410-bb7e-d625b242e4a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:41.214693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:41.215745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:41.216705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:41.216705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:41.216705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:41.216705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:41.216705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:41.216705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:41.216705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:41.216705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:41.216705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:41.216705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:41.216705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 449/902] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 05:20:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:41.221721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d9ec3-0614-4f81-98e3-7dc430241611 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:41.338446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d9ec3-0614-4f81-98e3-7dc430241611 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:41.375947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20943-46c2-456c-a5dd-8a557b1c62e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:41.376620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20943-46c2-456c-a5dd-8a557b1c62e4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:41.376908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20943-46c2-456c-a5dd-8a557b1c62e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:41.377218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20943-46c2-456c-a5dd-8a557b1c62e4 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:41.378021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d20943-46c2-456c-a5dd-8a557b1c62e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:41.378323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d20943-46c2-456c-a5dd-8a557b1c62e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:41.379764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d20943-46c2-456c-a5dd-8a557b1c62e4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:41.398287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 454/903] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 05:20:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:41.406241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae1fcc-e0b2-4410-bb7e-d625b242e4a3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:41.474763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:41.514799 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae1fcc-e0b2-4410-bb7e-d625b242e4a3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:41.554787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66be84-056f-434c-9da4-21651f4ef35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:41.555517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66be84-056f-434c-9da4-21651f4ef35b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:41.555799 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66be84-056f-434c-9da4-21651f4ef35b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:41.556069 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66be84-056f-434c-9da4-21651f4ef35b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:41.584184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4482-727d-4e1e-9670-50ddcb4bf029 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:41.584506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4482-727d-4e1e-9670-50ddcb4bf029 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:41.585021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f4482-727d-4e1e-9670-50ddcb4bf029 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:41.587661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 455/904] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:41.594363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1013236-e88b-4695-9ecb-538724a679e3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:41.594885 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1013236-e88b-4695-9ecb-538724a679e3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:41.595382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1013236-e88b-4695-9ecb-538724a679e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:41.613452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c1013236-e88b-4695-9ecb-538724a679e3 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:41.615391 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c1013236-e88b-4695-9ecb-538724a679e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:41.631684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:41.635220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66be84-056f-434c-9da4-21651f4ef35b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:41.636929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66be84-056f-434c-9da4-21651f4ef35b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:41.691409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 456/905] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:41.713517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:41.715746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1013236-e88b-4695-9ecb-538724a679e3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:41.747896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 450/906] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:41 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:20:41.757191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66be84-056f-434c-9da4-21651f4ef35b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:41.846372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1013236-e88b-4695-9ecb-538724a679e3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:41.860316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66be84-056f-434c-9da4-21651f4ef35b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:41.892953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33b8e2-3f89-4180-ac29-9afb47acae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:41.894022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33b8e2-3f89-4180-ac29-9afb47acae03 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:41.894301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33b8e2-3f89-4180-ac29-9afb47acae03 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:41.894570 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33b8e2-3f89-4180-ac29-9afb47acae03 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:41.895469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33b8e2-3f89-4180-ac29-9afb47acae03 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:41.896949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33b8e2-3f89-4180-ac29-9afb47acae03 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:41.899347 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235a234-cacb-4412-a1e6-abe6ce79b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:41.900205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235a234-cacb-4412-a1e6-abe6ce79b02f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:41.900686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235a234-cacb-4412-a1e6-abe6ce79b02f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:41.901159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235a234-cacb-4412-a1e6-abe6ce79b02f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6f33b8e2-3f89-4180-ac29-9afb47acae03 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:41.907141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:41.908171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:41.909025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 457/907] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:20:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:41.913949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33b8e2-3f89-4180-ac29-9afb47acae03 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:41.915788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235a234-cacb-4412-a1e6-abe6ce79b02f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:41.917512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235a234-cacb-4412-a1e6-abe6ce79b02f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:41.930190 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4235a234-cacb-4412-a1e6-abe6ce79b02f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:41.938179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:41.939135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:41.940043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:41.940043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:41.940043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:41.940043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:41.946779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 451/908] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:41.946779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235a234-cacb-4412-a1e6-abe6ce79b02f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:41.969534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:42.053405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33b8e2-3f89-4180-ac29-9afb47acae03 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:42.066621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235a234-cacb-4412-a1e6-abe6ce79b02f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:42.103561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7a94a-5202-4200-b337-f6689a9176da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:42.104374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7a94a-5202-4200-b337-f6689a9176da None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:42.104715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7a94a-5202-4200-b337-f6689a9176da None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:42.105057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7a94a-5202-4200-b337-f6689a9176da None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:42.105381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d0c2a-1991-4ce2-ac4d-8545732a918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:42.105928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7a94a-5202-4200-b337-f6689a9176da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:42.106295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7a94a-5202-4200-b337-f6689a9176da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:42.106664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d0c2a-1991-4ce2-ac4d-8545732a918a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:42.107115 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d0c2a-1991-4ce2-ac4d-8545732a918a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:42.107554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d0c2a-1991-4ce2-ac4d-8545732a918a None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:42.107927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7a94a-5202-4200-b337-f6689a9176da None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:42.108585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d0c2a-1991-4ce2-ac4d-8545732a918a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:42.109082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d0c2a-1991-4ce2-ac4d-8545732a918a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:42.111656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d0c2a-1991-4ce2-ac4d-8545732a918a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:42.118952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 458/909] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:20:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:42.124636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d0c2a-1991-4ce2-ac4d-8545732a918a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:42.125793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 452/910] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:42.126809 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7a94a-5202-4200-b337-f6689a9176da None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:42.217057 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:42.238226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:42.249274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d0c2a-1991-4ce2-ac4d-8545732a918a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:42.269188 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7a94a-5202-4200-b337-f6689a9176da None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:42.286210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14a0c0-3cb1-4744-bf60-80a5c29c4d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:42.286835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14a0c0-3cb1-4744-bf60-80a5c29c4d59 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:42.287116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14a0c0-3cb1-4744-bf60-80a5c29c4d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:42.287387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14a0c0-3cb1-4744-bf60-80a5c29c4d59 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:42.288062 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14a0c0-3cb1-4744-bf60-80a5c29c4d59 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:42.288363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14a0c0-3cb1-4744-bf60-80a5c29c4d59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:42.290321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14a0c0-3cb1-4744-bf60-80a5c29c4d59 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:42.299317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 459/911] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 05:20:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:42.299317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cce21-fdf9-4023-95b7-0ffb4af76db2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:42.299317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cce21-fdf9-4023-95b7-0ffb4af76db2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:42.299317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cce21-fdf9-4023-95b7-0ffb4af76db2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:42.302626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 460/912] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:42.303360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cce21-fdf9-4023-95b7-0ffb4af76db2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:42.313461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb50b4-8438-4504-84f2-d4b0784d2197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:42.314532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb50b4-8438-4504-84f2-d4b0784d2197 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:42.314532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb50b4-8438-4504-84f2-d4b0784d2197 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:42.314761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb50b4-8438-4504-84f2-d4b0784d2197 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:42.323899 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb50b4-8438-4504-84f2-d4b0784d2197 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:42.325364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb50b4-8438-4504-84f2-d4b0784d2197 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e2eb50b4-8438-4504-84f2-d4b0784d2197 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:42.337323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:42.338252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:42.339159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:42.339159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:42.339159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:42.339159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:42.339159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:42.339159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:42.339159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:42.339159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:42.339159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 453/913] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:42.340150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac61e48-81ae-46f9-8bcd-77fa76dbcf3a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:42.340150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac61e48-81ae-46f9-8bcd-77fa76dbcf3a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:42.340150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac61e48-81ae-46f9-8bcd-77fa76dbcf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:42.358296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4ac61e48-81ae-46f9-8bcd-77fa76dbcf3a None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:42.359501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4ac61e48-81ae-46f9-8bcd-77fa76dbcf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:42.419225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cce21-fdf9-4023-95b7-0ffb4af76db2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:42.445910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 454/914] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:42.446620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac61e48-81ae-46f9-8bcd-77fa76dbcf3a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:42.460092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce4166-6892-4281-9aba-9a40ca37571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:42.460807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce4166-6892-4281-9aba-9a40ca37571e None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:42.461091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce4166-6892-4281-9aba-9a40ca37571e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:42.461393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce4166-6892-4281-9aba-9a40ca37571e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:42.462158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce4166-6892-4281-9aba-9a40ca37571e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:42.463522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce4166-6892-4281-9aba-9a40ca37571e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:42.469269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:42.514679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:42.547809 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac61e48-81ae-46f9-8bcd-77fa76dbcf3a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:42.565845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 461/915] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:20:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:42.566715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce4166-6892-4281-9aba-9a40ca37571e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:42.612770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73aa77-a8d8-4924-b8c8-51f144d30096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:42.613451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73aa77-a8d8-4924-b8c8-51f144d30096 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:42.613703 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73aa77-a8d8-4924-b8c8-51f144d30096 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:42.613967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73aa77-a8d8-4924-b8c8-51f144d30096 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:42.614762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73aa77-a8d8-4924-b8c8-51f144d30096 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:42.615066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73aa77-a8d8-4924-b8c8-51f144d30096 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:42.616502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73aa77-a8d8-4924-b8c8-51f144d30096 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:42.631502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 455/916] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:42.639811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73aa77-a8d8-4924-b8c8-51f144d30096 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:42.707872 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce4166-6892-4281-9aba-9a40ca37571e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:42.752063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba799a0-53f9-4558-9563-0196fcab65d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:42.752687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba799a0-53f9-4558-9563-0196fcab65d8 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:42.752798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba799a0-53f9-4558-9563-0196fcab65d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:42.753073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba799a0-53f9-4558-9563-0196fcab65d8 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:42.753854 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba799a0-53f9-4558-9563-0196fcab65d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:42.755263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba799a0-53f9-4558-9563-0196fcab65d8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:42.779679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73aa77-a8d8-4924-b8c8-51f144d30096 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:42.803179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:42.816044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb5bac-8770-451d-89db-f0d2dd1c8e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:42.816708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb5bac-8770-451d-89db-f0d2dd1c8e7e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:42.816985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb5bac-8770-451d-89db-f0d2dd1c8e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:42.817277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb5bac-8770-451d-89db-f0d2dd1c8e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:42.818062 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb5bac-8770-451d-89db-f0d2dd1c8e7e None admin] RBAC: Adding query filter params (role.id=64ab1a99959f496c9cca03b0df885dd6, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=c8577537a1a84cffb5d8aebc4f41e8e0) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:42.818362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb5bac-8770-451d-89db-f0d2dd1c8e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:42.819784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb5bac-8770-451d-89db-f0d2dd1c8e7e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:42.826123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 456/917] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:42 2022] GET /identity/v3/role_assignments?user.id=c8577537a1a84cffb5d8aebc4f41e8e0&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=64ab1a99959f496c9cca03b0df885dd6 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:42.839378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 462/918] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:20:42 2022] POST /identity/v3/services => generated 241 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:43.236860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973411bd-8812-432e-81aa-8d85ce9f6993 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:43.237217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973411bd-8812-432e-81aa-8d85ce9f6993 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:43.237442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973411bd-8812-432e-81aa-8d85ce9f6993 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:43.239031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 457/919] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:43.245104 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed605041-f6f8-49f4-9da8-0d90d2d9b2ef None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:43.245618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed605041-f6f8-49f4-9da8-0d90d2d9b2ef None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:43.245698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed605041-f6f8-49f4-9da8-0d90d2d9b2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:43.264319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ed605041-f6f8-49f4-9da8-0d90d2d9b2ef None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:43.265558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ed605041-f6f8-49f4-9da8-0d90d2d9b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:43.315172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:43.343329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 463/920] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:43.366069 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973411bd-8812-432e-81aa-8d85ce9f6993 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:43.474278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973411bd-8812-432e-81aa-8d85ce9f6993 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:43.515450 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0fda8-4131-404f-b5d9-ea8977ce03bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:43.516087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0fda8-4131-404f-b5d9-ea8977ce03bc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:43.516361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0fda8-4131-404f-b5d9-ea8977ce03bc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:43.516629 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0fda8-4131-404f-b5d9-ea8977ce03bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:43.517278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0fda8-4131-404f-b5d9-ea8977ce03bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:43.518635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0fda8-4131-404f-b5d9-ea8977ce03bc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a5c0fda8-4131-404f-b5d9-ea8977ce03bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:43.528710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:43.529696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:43.530548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 458/921] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 05:20:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:43.538245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed605041-f6f8-49f4-9da8-0d90d2d9b2ef None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:43.644446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed605041-f6f8-49f4-9da8-0d90d2d9b2ef None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:43.682668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680edde-b799-4b05-aea2-c91852684bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:43.683296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680edde-b799-4b05-aea2-c91852684bdd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:43.683578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680edde-b799-4b05-aea2-c91852684bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:43.683846 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680edde-b799-4b05-aea2-c91852684bdd None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:43.684523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680edde-b799-4b05-aea2-c91852684bdd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:43.684822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680edde-b799-4b05-aea2-c91852684bdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:43.686214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680edde-b799-4b05-aea2-c91852684bdd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:43.691429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 464/922] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 05:20:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:43.697459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0fda8-4131-404f-b5d9-ea8977ce03bc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:43.755417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:43.809992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0fda8-4131-404f-b5d9-ea8977ce03bc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:43.846131 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185708b3-e8b0-492d-b525-0684736b8847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:43.846746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185708b3-e8b0-492d-b525-0684736b8847 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:43.847024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185708b3-e8b0-492d-b525-0684736b8847 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:43.847295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185708b3-e8b0-492d-b525-0684736b8847 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:43.848020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185708b3-e8b0-492d-b525-0684736b8847 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:43.848339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185708b3-e8b0-492d-b525-0684736b8847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:43.849735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185708b3-e8b0-492d-b525-0684736b8847 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:43.855625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 459/923] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 05:20:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:43.862960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680edde-b799-4b05-aea2-c91852684bdd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:43.912807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:43.973933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680edde-b799-4b05-aea2-c91852684bdd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:44.009427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5dc96-6884-405e-8685-e37874ce5547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:44.009965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5dc96-6884-405e-8685-e37874ce5547 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:44.010243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5dc96-6884-405e-8685-e37874ce5547 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:44.010514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5dc96-6884-405e-8685-e37874ce5547 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:44.011219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5dc96-6884-405e-8685-e37874ce5547 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:44.012577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5dc96-6884-405e-8685-e37874ce5547 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:44.121098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 465/924] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:20:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:44.696390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd080-67d5-4e1c-b85d-274280947619 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:44.696805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd080-67d5-4e1c-b85d-274280947619 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:44.696984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd080-67d5-4e1c-b85d-274280947619 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:44.698601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 460/925] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:44.703832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dfe2b-d39e-49b7-99f5-b92cb232cd03 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:44.704269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dfe2b-d39e-49b7-99f5-b92cb232cd03 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:44.704367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dfe2b-d39e-49b7-99f5-b92cb232cd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:44.722498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0d8dfe2b-d39e-49b7-99f5-b92cb232cd03 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:44.723687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0d8dfe2b-d39e-49b7-99f5-b92cb232cd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:44.799184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 466/926] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:44.822884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd080-67d5-4e1c-b85d-274280947619 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:44.931083 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd080-67d5-4e1c-b85d-274280947619 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:44.945623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:44.968190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356f0d2-6ac6-4e01-95e0-4b132d3ae118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:44.968190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356f0d2-6ac6-4e01-95e0-4b132d3ae118 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:44.968190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356f0d2-6ac6-4e01-95e0-4b132d3ae118 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:44.968190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356f0d2-6ac6-4e01-95e0-4b132d3ae118 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:44.968567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356f0d2-6ac6-4e01-95e0-4b132d3ae118 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:44.969987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356f0d2-6ac6-4e01-95e0-4b132d3ae118 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:44.972665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: WARNING keystone.server.flask.common [None req-2356f0d2-6ac6-4e01-95e0-4b132d3ae118 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 05:20:44.989304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe00da-88c5-4b19-a7d0-934200bcde05 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:44.989595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe00da-88c5-4b19-a7d0-934200bcde05 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:44.990105 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe00da-88c5-4b19-a7d0-934200bcde05 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:44.991482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 467/927] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:44.994702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c6dc3-9d60-49e6-85fd-fbfbaac82a08 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:44.994991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c6dc3-9d60-49e6-85fd-fbfbaac82a08 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:44.995269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c6dc3-9d60-49e6-85fd-fbfbaac82a08 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:44.996556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 468/928] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:44.997605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3e3f5-717a-4091-865e-d0ac1d8e68df None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:44.997886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3e3f5-717a-4091-865e-d0ac1d8e68df None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:44.998161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3e3f5-717a-4091-865e-d0ac1d8e68df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:45.016890 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9bf3e3f5-717a-4091-865e-d0ac1d8e68df None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:45.018096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9bf3e3f5-717a-4091-865e-d0ac1d8e68df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:45.022329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.sql.core [None req-2356f0d2-6ac6-4e01-95e0-4b132d3ae118 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 05:20:45.022329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 05:20:45.022329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [parameters: {'id': '294e204f15c74ca1a2b12f05357fef6d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 05:20:45.022329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80315) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2356f0d2-6ac6-4e01-95e0-4b132d3ae118 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 294e204f15c74ca1a2b12f05357fef6d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 294e204f15c74ca1a2b12f05357fef6d. Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:20:45.029966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 05:20:45.030810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application yield resource Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise self.value Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application session.commit() Jul 28 05:20:45.031812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.flush() Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application compat.raise_( Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 05:20:45.032744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 05:20:45.033743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:20:45.034600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [parameters: {'id': '294e204f15c74ca1a2b12f05357fef6d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:45.035499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:45.039254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 294e204f15c74ca1a2b12f05357fef6d. Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 461/929] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 05:20:44 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c3b5-244e-4ed0-adbf-4603e5cd031b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:45.043169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c3b5-244e-4ed0-adbf-4603e5cd031b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:45.044808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c3b5-244e-4ed0-adbf-4603e5cd031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:45.044950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:45.053512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8a09c3b5-244e-4ed0-adbf-4603e5cd031b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:45.055598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a09c3b5-244e-4ed0-adbf-4603e5cd031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:45.100028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 469/930] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:45.101264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3e3f5-717a-4091-865e-d0ac1d8e68df None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:45.135185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 462/931] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:45.137081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09c3b5-244e-4ed0-adbf-4603e5cd031b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:45.209604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3e3f5-717a-4091-865e-d0ac1d8e68df None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:45.244742 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:45.247690 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09c3b5-244e-4ed0-adbf-4603e5cd031b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:45.248058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678511a-a5f2-4ca6-9edc-b918366d37f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:45.248771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678511a-a5f2-4ca6-9edc-b918366d37f2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:45.253056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678511a-a5f2-4ca6-9edc-b918366d37f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:45.253056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678511a-a5f2-4ca6-9edc-b918366d37f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:45.256875 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678511a-a5f2-4ca6-9edc-b918366d37f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:45.258922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678511a-a5f2-4ca6-9edc-b918366d37f2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e678511a-a5f2-4ca6-9edc-b918366d37f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:45.276338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:45.283271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:45.284438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:45.284438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:45.284438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:45.284438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:45.284438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:45.284438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:45.284438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:45.284438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:45.284438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 470/932] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:45.284438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678511a-a5f2-4ca6-9edc-b918366d37f2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:45.289233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fe00d-be8e-4d29-9d6e-127f03e84e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:45.289916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe00d-be8e-4d29-9d6e-127f03e84e5e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:45.290193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe00d-be8e-4d29-9d6e-127f03e84e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:45.290469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe00d-be8e-4d29-9d6e-127f03e84e5e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:45.291095 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fe00d-be8e-4d29-9d6e-127f03e84e5e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:45.292669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fe00d-be8e-4d29-9d6e-127f03e84e5e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:45.300364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ea3fe00d-be8e-4d29-9d6e-127f03e84e5e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:45.302968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:45.304186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:45.305454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 463/933] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 05:20:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:45.306267 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fe00d-be8e-4d29-9d6e-127f03e84e5e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:45.396032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678511a-a5f2-4ca6-9edc-b918366d37f2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:45.419877 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fe00d-be8e-4d29-9d6e-127f03e84e5e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:45.435798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e6656-065d-4d62-a832-c6c986af876b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:45.436628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e6656-065d-4d62-a832-c6c986af876b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:45.436812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e6656-065d-4d62-a832-c6c986af876b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:45.437065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e6656-065d-4d62-a832-c6c986af876b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:45.448087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e6656-065d-4d62-a832-c6c986af876b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7e2e6656-065d-4d62-a832-c6c986af876b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:45.452907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:45.454303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 471/934] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 05:20:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:45.455246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e6656-065d-4d62-a832-c6c986af876b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:45.461639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09f91-0536-4585-93ea-115cbf82f078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:45.462277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09f91-0536-4585-93ea-115cbf82f078 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:45.462601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09f91-0536-4585-93ea-115cbf82f078 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:45.462830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09f91-0536-4585-93ea-115cbf82f078 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:45.463564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b09f91-0536-4585-93ea-115cbf82f078 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:45.463869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b09f91-0536-4585-93ea-115cbf82f078 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:45.465708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b09f91-0536-4585-93ea-115cbf82f078 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:45.504002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 464/935] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:45.504002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09f91-0536-4585-93ea-115cbf82f078 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:45.527598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:45.564577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:45.593827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e6656-065d-4d62-a832-c6c986af876b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:45.615091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09f91-0536-4585-93ea-115cbf82f078 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:45.635235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c9d9e-4aab-48c4-b608-18cf86b3890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:45.636022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c9d9e-4aab-48c4-b608-18cf86b3890c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:45.636308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c9d9e-4aab-48c4-b608-18cf86b3890c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:45.636582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c9d9e-4aab-48c4-b608-18cf86b3890c None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:45.637310 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c9d9e-4aab-48c4-b608-18cf86b3890c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:45.637616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c9d9e-4aab-48c4-b608-18cf86b3890c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:45.639246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c9d9e-4aab-48c4-b608-18cf86b3890c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:45.649636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 472/936] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 05:20:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:45.651844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c9d9e-4aab-48c4-b608-18cf86b3890c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:45.657410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff9b6-736d-4963-975b-fe72cb00235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:45.657410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff9b6-736d-4963-975b-fe72cb00235e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:45.657410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff9b6-736d-4963-975b-fe72cb00235e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:45.657410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff9b6-736d-4963-975b-fe72cb00235e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:45.658387 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dff9b6-736d-4963-975b-fe72cb00235e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:45.659699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dff9b6-736d-4963-975b-fe72cb00235e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:45.660277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dff9b6-736d-4963-975b-fe72cb00235e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:45.671205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 465/937] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 05:20:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:45.677094 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff9b6-736d-4963-975b-fe72cb00235e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:45.779242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c9d9e-4aab-48c4-b608-18cf86b3890c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:45.797713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:45.814024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff9b6-736d-4963-975b-fe72cb00235e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:45.825256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529995dc-7274-4a91-ba26-8848201d73a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:45.826221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529995dc-7274-4a91-ba26-8848201d73a1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:45.826712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529995dc-7274-4a91-ba26-8848201d73a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:45.827205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529995dc-7274-4a91-ba26-8848201d73a1 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:45.828535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529995dc-7274-4a91-ba26-8848201d73a1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:45.829060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529995dc-7274-4a91-ba26-8848201d73a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:45.830663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529995dc-7274-4a91-ba26-8848201d73a1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:45.836572 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 473/938] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 05:20:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:45.842117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529995dc-7274-4a91-ba26-8848201d73a1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:45.844825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:45.860316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee56a0-5fc3-4ad4-98bf-7dad8bc0c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:45.866528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee56a0-5fc3-4ad4-98bf-7dad8bc0c347 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:45.866528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee56a0-5fc3-4ad4-98bf-7dad8bc0c347 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:45.866528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee56a0-5fc3-4ad4-98bf-7dad8bc0c347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:45.877781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee56a0-5fc3-4ad4-98bf-7dad8bc0c347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:45.879574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee56a0-5fc3-4ad4-98bf-7dad8bc0c347 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-67ee56a0-5fc3-4ad4-98bf-7dad8bc0c347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:45.898609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:45.899670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:45.900684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:45.900684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:45.900684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:45.900684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:45.900684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 466/939] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:45.905797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee56a0-5fc3-4ad4-98bf-7dad8bc0c347 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:45.959723 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529995dc-7274-4a91-ba26-8848201d73a1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:45.997012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd588b-973f-46ac-b10c-267ae70561e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:45.998002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd588b-973f-46ac-b10c-267ae70561e9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:45.998532 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd588b-973f-46ac-b10c-267ae70561e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:45.999003 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd588b-973f-46ac-b10c-267ae70561e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.000001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd588b-973f-46ac-b10c-267ae70561e9 None admin] RBAC: Adding query filter params (interface=public, service_id=0c06c1f4d27147b5b642b53f8d7be7ae, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:46.000502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd588b-973f-46ac-b10c-267ae70561e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:46.002086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd588b-973f-46ac-b10c-267ae70561e9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:46.012787 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 474/940] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 05:20:45 2022] GET /identity/v3/endpoints?service_id=0c06c1f4d27147b5b642b53f8d7be7ae&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:46.013942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd588b-973f-46ac-b10c-267ae70561e9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:46.035920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee56a0-5fc3-4ad4-98bf-7dad8bc0c347 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:46.080661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eaf3a-a2a9-4117-91ec-b8baca11c605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:46.081439 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eaf3a-a2a9-4117-91ec-b8baca11c605 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:46.081750 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eaf3a-a2a9-4117-91ec-b8baca11c605 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:46.082128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eaf3a-a2a9-4117-91ec-b8baca11c605 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.082831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eaf3a-a2a9-4117-91ec-b8baca11c605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:46.083134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eaf3a-a2a9-4117-91ec-b8baca11c605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:46.084723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eaf3a-a2a9-4117-91ec-b8baca11c605 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:46.088652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:46.094212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:46.102625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 467/941] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:46.107620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eaf3a-a2a9-4117-91ec-b8baca11c605 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:46.139166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd588b-973f-46ac-b10c-267ae70561e9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:46.187569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f2db9-2288-413b-94ae-e27384360947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:46.189107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f2db9-2288-413b-94ae-e27384360947 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:46.189943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f2db9-2288-413b-94ae-e27384360947 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:46.190409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f2db9-2288-413b-94ae-e27384360947 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.191238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f2db9-2288-413b-94ae-e27384360947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:46.193628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f2db9-2288-413b-94ae-e27384360947 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:46.202717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 475/942] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 05:20:46 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:20:46.204161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cf0ea-2434-46de-b062-7a525c14d9f6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:46.205048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cf0ea-2434-46de-b062-7a525c14d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:46.205559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cf0ea-2434-46de-b062-7a525c14d9f6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.208145 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 476/943] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:46.215643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe078345-af90-48df-b1ee-1eb0441d22e4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:46.216259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe078345-af90-48df-b1ee-1eb0441d22e4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:46.216731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe078345-af90-48df-b1ee-1eb0441d22e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.235571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eaf3a-a2a9-4117-91ec-b8baca11c605 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:46.238318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fe078345-af90-48df-b1ee-1eb0441d22e4 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:46.239963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fe078345-af90-48df-b1ee-1eb0441d22e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:46.276412 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5f685-2b24-40b4-8ada-d14f809fd768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:46.277633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5f685-2b24-40b4-8ada-d14f809fd768 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:46.277921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5f685-2b24-40b4-8ada-d14f809fd768 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:46.278218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5f685-2b24-40b4-8ada-d14f809fd768 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.287993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5f685-2b24-40b4-8ada-d14f809fd768 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:46.289984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5f685-2b24-40b4-8ada-d14f809fd768 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-40d5f685-2b24-40b4-8ada-d14f809fd768 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:46.306975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:46.308066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:46.309025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:46.309025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:46.309025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:46.309025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:46.309025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:46.309025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:46.309025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:46.309025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:46.309025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:46.309025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:46.313363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 468/944] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 05:20:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:46.314740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5f685-2b24-40b4-8ada-d14f809fd768 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:46.337568 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 477/945] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:46.353686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe078345-af90-48df-b1ee-1eb0441d22e4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:46.390901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:46.434261 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:46.452206 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5f685-2b24-40b4-8ada-d14f809fd768 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:46.476623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe078345-af90-48df-b1ee-1eb0441d22e4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:46.498452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bfd83-e8ea-4379-a5d8-f9cf923288dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:46.499739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bfd83-e8ea-4379-a5d8-f9cf923288dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:46.500464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bfd83-e8ea-4379-a5d8-f9cf923288dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:46.500900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bfd83-e8ea-4379-a5d8-f9cf923288dc None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.502060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bfd83-e8ea-4379-a5d8-f9cf923288dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:46.502837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bfd83-e8ea-4379-a5d8-f9cf923288dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:46.504884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bfd83-e8ea-4379-a5d8-f9cf923288dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:46.513989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f54a6d-1bf1-41f1-90c2-bf1ccfb46d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:46.514649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f54a6d-1bf1-41f1-90c2-bf1ccfb46d16 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:46.514906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f54a6d-1bf1-41f1-90c2-bf1ccfb46d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:46.515198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f54a6d-1bf1-41f1-90c2-bf1ccfb46d16 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.515794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f54a6d-1bf1-41f1-90c2-bf1ccfb46d16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:46.517162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f54a6d-1bf1-41f1-90c2-bf1ccfb46d16 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-09f54a6d-1bf1-41f1-90c2-bf1ccfb46d16 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:46.527070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:46.528371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:46.529497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 478/946] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:46.530422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 469/947] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 05:20:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:46.538168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f54a6d-1bf1-41f1-90c2-bf1ccfb46d16 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:46.538381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bfd83-e8ea-4379-a5d8-f9cf923288dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:46.650216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bfd83-e8ea-4379-a5d8-f9cf923288dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:46.666959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f54a6d-1bf1-41f1-90c2-bf1ccfb46d16 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:46.671923 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:46.694210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:46.706330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a9f46-3d66-4495-85e9-ff8e3cdd649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:46.706330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9f46-3d66-4495-85e9-ff8e3cdd649a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:46.706330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9f46-3d66-4495-85e9-ff8e3cdd649a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:46.706330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9f46-3d66-4495-85e9-ff8e3cdd649a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.707261 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc67464-7907-4a71-808b-3f7c08eb1aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:46.708063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67464-7907-4a71-808b-3f7c08eb1aef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:46.708431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67464-7907-4a71-808b-3f7c08eb1aef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:46.708796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc67464-7907-4a71-808b-3f7c08eb1aef None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.709636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc67464-7907-4a71-808b-3f7c08eb1aef None admin] RBAC: Adding query filter params (name=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:46.710033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc67464-7907-4a71-808b-3f7c08eb1aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:46.710517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a9f46-3d66-4495-85e9-ff8e3cdd649a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:46.711991 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a9f46-3d66-4495-85e9-ff8e3cdd649a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:46.712294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc67464-7907-4a71-808b-3f7c08eb1aef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:46.722594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 479/948] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:46.723602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc67464-7907-4a71-808b-3f7c08eb1aef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cb6a9f46-3d66-4495-85e9-ff8e3cdd649a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:46.729662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:46.730672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:46.731798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:46.731798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:46.731798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:46.731798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:46.731798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 470/949] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:46.738461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a9f46-3d66-4495-85e9-ff8e3cdd649a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:46.855626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc67464-7907-4a71-808b-3f7c08eb1aef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:46.863334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a9f46-3d66-4495-85e9-ff8e3cdd649a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:46.900692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f6f7-6563-4a7c-93c8-da0b6d3608d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:46.901353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f6f7-6563-4a7c-93c8-da0b6d3608d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:46.901630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f6f7-6563-4a7c-93c8-da0b6d3608d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:46.901897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f6f7-6563-4a7c-93c8-da0b6d3608d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.902582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f6f7-6563-4a7c-93c8-da0b6d3608d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:46.902878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f6f7-6563-4a7c-93c8-da0b6d3608d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:46.904454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f6f7-6563-4a7c-93c8-da0b6d3608d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:46.904927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e2d40-6804-41fe-98bf-27808b8e1ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:46.906070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e2d40-6804-41fe-98bf-27808b8e1ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:46.906576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e2d40-6804-41fe-98bf-27808b8e1ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:46.907660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e2d40-6804-41fe-98bf-27808b8e1ac7 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:46.908556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e2d40-6804-41fe-98bf-27808b8e1ac7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:46.909077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e2d40-6804-41fe-98bf-27808b8e1ac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:46.910648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e2d40-6804-41fe-98bf-27808b8e1ac7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:46.917694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 480/950] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:46.925544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 471/951] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:46.929111 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e2d40-6804-41fe-98bf-27808b8e1ac7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:46.997405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:47.049500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e2d40-6804-41fe-98bf-27808b8e1ac7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:47.091176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d889320-7b71-4987-bbff-32357889d5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:47.092189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d889320-7b71-4987-bbff-32357889d5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:47.092688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d889320-7b71-4987-bbff-32357889d5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:47.093185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d889320-7b71-4987-bbff-32357889d5f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:47.100448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d889320-7b71-4987-bbff-32357889d5f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:47.102844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d889320-7b71-4987-bbff-32357889d5f7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4d889320-7b71-4987-bbff-32357889d5f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:47.114929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:47.115981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:47.117014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:47.117014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:47.117014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:47.117014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:47.117014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:47.117014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:47.117014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:47.117014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:47.118762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 481/952] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:47.124746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f6f7-6563-4a7c-93c8-da0b6d3608d2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:47.156021 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:47.234276 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f6f7-6563-4a7c-93c8-da0b6d3608d2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:47.269947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f65d8d-6963-48ef-b52e-8bd3ebbe1807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:47.270898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f65d8d-6963-48ef-b52e-8bd3ebbe1807 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:47.271377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f65d8d-6963-48ef-b52e-8bd3ebbe1807 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:47.271849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f65d8d-6963-48ef-b52e-8bd3ebbe1807 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:47.272793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f65d8d-6963-48ef-b52e-8bd3ebbe1807 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:47.273907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f65d8d-6963-48ef-b52e-8bd3ebbe1807 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:47.275851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f65d8d-6963-48ef-b52e-8bd3ebbe1807 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:47.288528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 472/953] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:47.295363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d889320-7b71-4987-bbff-32357889d5f7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:47.405334 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d889320-7b71-4987-bbff-32357889d5f7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:47.419302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:47.443167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45852575-5ffa-4ffc-80ed-131a98b86f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:47.444146 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45852575-5ffa-4ffc-80ed-131a98b86f94 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:47.444634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45852575-5ffa-4ffc-80ed-131a98b86f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:47.445874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45852575-5ffa-4ffc-80ed-131a98b86f94 None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/c8577537a1a84cffb5d8aebc4f41e8e0/roles/64ab1a99959f496c9cca03b0df885dd6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:47.448484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45852575-5ffa-4ffc-80ed-131a98b86f94 None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=c8577537a1a84cffb5d8aebc4f41e8e0, role_id=64ab1a99959f496c9cca03b0df885dd6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:47.450197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45852575-5ffa-4ffc-80ed-131a98b86f94 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:47.552040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 482/954] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:20:47 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/c8577537a1a84cffb5d8aebc4f41e8e0/roles/64ab1a99959f496c9cca03b0df885dd6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:20:47.691818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0f57-08b0-46be-9aa8-312d8b0f4178 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:47.692020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0f57-08b0-46be-9aa8-312d8b0f4178 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:47.692268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0f57-08b0-46be-9aa8-312d8b0f4178 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:47.694005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 473/955] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:47.700359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ecc26-68e2-4d4c-b2d5-303c2d9e566c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:47.700664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ecc26-68e2-4d4c-b2d5-303c2d9e566c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:47.700914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ecc26-68e2-4d4c-b2d5-303c2d9e566c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:47.721887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c68ecc26-68e2-4d4c-b2d5-303c2d9e566c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:47.723071 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c68ecc26-68e2-4d4c-b2d5-303c2d9e566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:47.809281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 483/956] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:47.832319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac0f57-08b0-46be-9aa8-312d8b0f4178 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:47.927760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:47.941959 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac0f57-08b0-46be-9aa8-312d8b0f4178 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:47.978626 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530797d-5202-4576-b30b-3fc116266288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:47.979316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530797d-5202-4576-b30b-3fc116266288 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:47.979597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530797d-5202-4576-b30b-3fc116266288 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:47.979872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530797d-5202-4576-b30b-3fc116266288 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:47.980619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530797d-5202-4576-b30b-3fc116266288 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:47.982201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530797d-5202-4576-b30b-3fc116266288 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:48.028080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.sql.core [None req-8530797d-5202-4576-b30b-3fc116266288 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 05:20:48.028080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 05:20:48.028080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [parameters: {'user_id': 'e1b964ae668e42a0b15629e3c703adec', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 05:20:48.028080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80315) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8530797d-5202-4576-b30b-3fc116266288 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jul 28 05:20:48.035014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:20:48.035903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application yield resource Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise self.value Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application session.commit() Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 05:20:48.036893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.flush() Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application compat.raise_( Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 05:20:48.037857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 05:20:48.039983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 05:20:48.040858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e1b964ae668e42a0b15629e3c703adec', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:48.043376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 05:20:48.045342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 05:20:48.058304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 05:20:48.058304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 05:20:48.058304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 05:20:48.058304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 05:20:48.058304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 05:20:48.058304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:48.058304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 474/957] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 05:20:47 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:48.059200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ecc26-68e2-4d4c-b2d5-303c2d9e566c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:48.158682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ecc26-68e2-4d4c-b2d5-303c2d9e566c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:48.160310 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:48.201584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf8a85-4680-4a1b-bc7f-9947344fdbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:48.202642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf8a85-4680-4a1b-bc7f-9947344fdbcd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:48.202921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf8a85-4680-4a1b-bc7f-9947344fdbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:48.203187 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf8a85-4680-4a1b-bc7f-9947344fdbcd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:48.211381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf8a85-4680-4a1b-bc7f-9947344fdbcd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:48.212883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf8a85-4680-4a1b-bc7f-9947344fdbcd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7faf8a85-4680-4a1b-bc7f-9947344fdbcd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:48.224944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:48.225911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:48.228052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:48.228052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:48.228052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:48.228052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:48.228052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:48.228052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:48.228052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:48.228052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:48.228052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 05:20:48.228052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:48.228052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 484/958] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:20:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:48.235100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530797d-5202-4576-b30b-3fc116266288 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:48.342883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530797d-5202-4576-b30b-3fc116266288 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:48.357521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566d366-70ce-4635-b02e-207b269d9db4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:48.358188 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566d366-70ce-4635-b02e-207b269d9db4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:48.358674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566d366-70ce-4635-b02e-207b269d9db4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:48.360508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 485/959] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:48.366154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd098-d117-4f95-9d48-3fb3d65c0e48 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:48.367386 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd098-d117-4f95-9d48-3fb3d65c0e48 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:48.367898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd098-d117-4f95-9d48-3fb3d65c0e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:48.386137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f712aa-0507-4903-846c-c1e6e614c89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:48.386751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f712aa-0507-4903-846c-c1e6e614c89b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:48.387031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f712aa-0507-4903-846c-c1e6e614c89b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:48.387300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f712aa-0507-4903-846c-c1e6e614c89b None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:48.387605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eedfd098-d117-4f95-9d48-3fb3d65c0e48 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:48.388063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f712aa-0507-4903-846c-c1e6e614c89b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:48.388361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f712aa-0507-4903-846c-c1e6e614c89b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:48.389429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eedfd098-d117-4f95-9d48-3fb3d65c0e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:48.390020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f712aa-0507-4903-846c-c1e6e614c89b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:48.445422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 475/960] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 05:20:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:48.465862 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 486/961] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:48.489960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f712aa-0507-4903-846c-c1e6e614c89b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:48.503998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:48.607389 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f712aa-0507-4903-846c-c1e6e614c89b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:48.645806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529a6ad-89e7-40b6-92d6-63e7df64ef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:48.646447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529a6ad-89e7-40b6-92d6-63e7df64ef71 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:48.646724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529a6ad-89e7-40b6-92d6-63e7df64ef71 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:48.647050 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529a6ad-89e7-40b6-92d6-63e7df64ef71 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:48.647674 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529a6ad-89e7-40b6-92d6-63e7df64ef71 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:48.649304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529a6ad-89e7-40b6-92d6-63e7df64ef71 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a529a6ad-89e7-40b6-92d6-63e7df64ef71 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:48.658407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:48.659548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:48.660637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 476/962] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 05:20:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:48.668077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfd098-d117-4f95-9d48-3fb3d65c0e48 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:48.771047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:48.780172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfd098-d117-4f95-9d48-3fb3d65c0e48 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:48.813778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef69620-8bda-4e5c-b16d-4ffb73efdb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:48.814434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef69620-8bda-4e5c-b16d-4ffb73efdb67 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:48.815084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef69620-8bda-4e5c-b16d-4ffb73efdb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:48.815702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef69620-8bda-4e5c-b16d-4ffb73efdb67 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:48.816920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef69620-8bda-4e5c-b16d-4ffb73efdb67 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:48.817296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef69620-8bda-4e5c-b16d-4ffb73efdb67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:48.818655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef69620-8bda-4e5c-b16d-4ffb73efdb67 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:48.823554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 487/963] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 05:20:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:48.829124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529a6ad-89e7-40b6-92d6-63e7df64ef71 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:48.901283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:48.932025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529a6ad-89e7-40b6-92d6-63e7df64ef71 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:48.965756 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f68a0f-651b-42f7-8fd1-f4bf87b2b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:48.966372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f68a0f-651b-42f7-8fd1-f4bf87b2b596 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:48.966650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f68a0f-651b-42f7-8fd1-f4bf87b2b596 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:48.966921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f68a0f-651b-42f7-8fd1-f4bf87b2b596 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:48.967592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f68a0f-651b-42f7-8fd1-f4bf87b2b596 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:48.967891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f68a0f-651b-42f7-8fd1-f4bf87b2b596 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:48.969283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f68a0f-651b-42f7-8fd1-f4bf87b2b596 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:48.979336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 477/964] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 05:20:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:48.980886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef69620-8bda-4e5c-b16d-4ffb73efdb67 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:49.082894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef69620-8bda-4e5c-b16d-4ffb73efdb67 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:49.095003 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825be27-bc45-4fdf-a949-8306f0cca405 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:49.095280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825be27-bc45-4fdf-a949-8306f0cca405 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:49.095556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825be27-bc45-4fdf-a949-8306f0cca405 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:49.097025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 478/965] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:49.102406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bdb3f-eda4-4d32-8b37-b23175123286 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:49.102749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bdb3f-eda4-4d32-8b37-b23175123286 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:49.103092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bdb3f-eda4-4d32-8b37-b23175123286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:49.119107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cdd03-c9ae-485d-b787-9edd8a852885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:49.119742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cdd03-c9ae-485d-b787-9edd8a852885 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:49.120051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cdd03-c9ae-485d-b787-9edd8a852885 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:49.120320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cdd03-c9ae-485d-b787-9edd8a852885 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:49.121019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cdd03-c9ae-485d-b787-9edd8a852885 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:49.121726 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2f6bdb3f-eda4-4d32-8b37-b23175123286 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:49.122442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cdd03-c9ae-485d-b787-9edd8a852885 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:49.123223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2f6bdb3f-eda4-4d32-8b37-b23175123286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:49.195315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 479/966] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:49.217729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bdb3f-eda4-4d32-8b37-b23175123286 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:49.253807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 488/967] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:20:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:20:49.287361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:49.326842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bdb3f-eda4-4d32-8b37-b23175123286 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:49.372321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce97e6-6b0d-4571-a891-d21e54a8f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:49.372869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce97e6-6b0d-4571-a891-d21e54a8f45b None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:49.373166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce97e6-6b0d-4571-a891-d21e54a8f45b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:49.373434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce97e6-6b0d-4571-a891-d21e54a8f45b None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:49.374125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce97e6-6b0d-4571-a891-d21e54a8f45b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:49.375491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce97e6-6b0d-4571-a891-d21e54a8f45b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:49.440349 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 480/968] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:20:49 2022] POST /identity/v3/services => generated 242 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:20:49.617197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53bdb2-368e-40a2-b346-aff397dd55f1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:49.617583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53bdb2-368e-40a2-b346-aff397dd55f1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:49.617825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53bdb2-368e-40a2-b346-aff397dd55f1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:49.619550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 489/969] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:49.624456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dafec-273c-4035-9cea-c0f44cf5f929 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:49.624693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dafec-273c-4035-9cea-c0f44cf5f929 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:49.624973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dafec-273c-4035-9cea-c0f44cf5f929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:49.643842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ca8dafec-273c-4035-9cea-c0f44cf5f929 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:49.645030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ca8dafec-273c-4035-9cea-c0f44cf5f929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:49.720431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 481/970] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:49.745679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53bdb2-368e-40a2-b346-aff397dd55f1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:49.762230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:49.850960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53bdb2-368e-40a2-b346-aff397dd55f1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:49.885322 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753be1a-04a8-4cb1-9f08-04157fa9da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:49.885891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753be1a-04a8-4cb1-9f08-04157fa9da57 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:49.886169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753be1a-04a8-4cb1-9f08-04157fa9da57 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:49.886440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753be1a-04a8-4cb1-9f08-04157fa9da57 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:49.896703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753be1a-04a8-4cb1-9f08-04157fa9da57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6753be1a-04a8-4cb1-9f08-04157fa9da57 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:49.902648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:49.903626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:49.904493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 490/971] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 05:20:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:49.910508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dafec-273c-4035-9cea-c0f44cf5f929 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:49.962640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:50.013625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dafec-273c-4035-9cea-c0f44cf5f929 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:50.047481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aa9de-718c-4eb3-9253-25cbabe4a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:50.048091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aa9de-718c-4eb3-9253-25cbabe4a084 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:50.048370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aa9de-718c-4eb3-9253-25cbabe4a084 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:50.048638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aa9de-718c-4eb3-9253-25cbabe4a084 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:50.049369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841aa9de-718c-4eb3-9253-25cbabe4a084 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:50.049943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841aa9de-718c-4eb3-9253-25cbabe4a084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:50.051307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841aa9de-718c-4eb3-9253-25cbabe4a084 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:50.059995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 482/972] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 05:20:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:50.065524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753be1a-04a8-4cb1-9f08-04157fa9da57 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:50.136728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:50.175123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753be1a-04a8-4cb1-9f08-04157fa9da57 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:50.213622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50689a-38cb-4a2f-96e3-cbc63d4ab962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:50.214293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50689a-38cb-4a2f-96e3-cbc63d4ab962 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:50.214542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50689a-38cb-4a2f-96e3-cbc63d4ab962 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:50.214813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50689a-38cb-4a2f-96e3-cbc63d4ab962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:50.224986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50689a-38cb-4a2f-96e3-cbc63d4ab962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:50.227294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50689a-38cb-4a2f-96e3-cbc63d4ab962 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fc50689a-38cb-4a2f-96e3-cbc63d4ab962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:50.241971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:50.242887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:50.248427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:50.248427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:50.248427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:50.248427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:50.248427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 491/973] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:50.248725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aa9de-718c-4eb3-9253-25cbabe4a084 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:50.352951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aa9de-718c-4eb3-9253-25cbabe4a084 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:50.363366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:50.387373 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d16340-2598-42ee-8331-b09bddb4074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:50.387911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d16340-2598-42ee-8331-b09bddb4074a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:50.388186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d16340-2598-42ee-8331-b09bddb4074a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:50.388451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d16340-2598-42ee-8331-b09bddb4074a None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:50.389153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d16340-2598-42ee-8331-b09bddb4074a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:50.389453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d16340-2598-42ee-8331-b09bddb4074a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:50.390811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d16340-2598-42ee-8331-b09bddb4074a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:50.409523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 483/974] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:50.410260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50689a-38cb-4a2f-96e3-cbc63d4ab962 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:50.517160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50689a-38cb-4a2f-96e3-cbc63d4ab962 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:50.541262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:50.552493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db37c0-a20a-4d5a-a67d-6c3e26097060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:50.553171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db37c0-a20a-4d5a-a67d-6c3e26097060 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:50.553441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db37c0-a20a-4d5a-a67d-6c3e26097060 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:50.553712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db37c0-a20a-4d5a-a67d-6c3e26097060 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:50.561771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db37c0-a20a-4d5a-a67d-6c3e26097060 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:50.563252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db37c0-a20a-4d5a-a67d-6c3e26097060 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-66db37c0-a20a-4d5a-a67d-6c3e26097060 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:50.576829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:50.577912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:50.578892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:50.578892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:50.578892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:50.578892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:50.578892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:50.578892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:50.578892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:50.578892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:50.578892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 05:20:50.578892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:50.578892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 492/975] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 05:20:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:50.583749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d16340-2598-42ee-8331-b09bddb4074a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:50.685514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d16340-2598-42ee-8331-b09bddb4074a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:50.719783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eae2f-c876-4c28-afc4-c378d5c54136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:50.720396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eae2f-c876-4c28-afc4-c378d5c54136 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:50.720676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eae2f-c876-4c28-afc4-c378d5c54136 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:50.720947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eae2f-c876-4c28-afc4-c378d5c54136 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:50.721800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eae2f-c876-4c28-afc4-c378d5c54136 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:50.722071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eae2f-c876-4c28-afc4-c378d5c54136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:50.723498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eae2f-c876-4c28-afc4-c378d5c54136 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:50.741179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 484/976] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 05:20:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:50.747505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db37c0-a20a-4d5a-a67d-6c3e26097060 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:50.847241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db37c0-a20a-4d5a-a67d-6c3e26097060 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:50.881805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d368c-85ce-45c9-8a77-44c61ec4c228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:50.882448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d368c-85ce-45c9-8a77-44c61ec4c228 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:50.882727 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d368c-85ce-45c9-8a77-44c61ec4c228 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:50.882996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d368c-85ce-45c9-8a77-44c61ec4c228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:50.936421 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:50.952798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d368c-85ce-45c9-8a77-44c61ec4c228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:50.954292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d368c-85ce-45c9-8a77-44c61ec4c228 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:51.055325 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 493/977] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:50 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:20:51.060909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eae2f-c876-4c28-afc4-c378d5c54136 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:51.089927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:51.169337 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eae2f-c876-4c28-afc4-c378d5c54136 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:51.206430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ab2ba-9bff-4454-892f-9f168f2b76e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:51.206988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab2ba-9bff-4454-892f-9f168f2b76e7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.207266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab2ba-9bff-4454-892f-9f168f2b76e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.207533 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab2ba-9bff-4454-892f-9f168f2b76e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.218409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ab2ba-9bff-4454-892f-9f168f2b76e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:51.219856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ab2ba-9bff-4454-892f-9f168f2b76e7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4f1ab2ba-9bff-4454-892f-9f168f2b76e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:51.235280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:51.236214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:51.237151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:51.237151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:51.237151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:51.237151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:51.237151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 485/978] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:51.243168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d368c-85ce-45c9-8a77-44c61ec4c228 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:51.329231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:51.343670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851a51-ed7c-4b1a-b979-285f748726eb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.344211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851a51-ed7c-4b1a-b979-285f748726eb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.344484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851a51-ed7c-4b1a-b979-285f748726eb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.345791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d368c-85ce-45c9-8a77-44c61ec4c228 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:51.346125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 486/979] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:51.350989 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d1b3-4662-4616-bf03-0a81f9a98c46 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.351262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d1b3-4662-4616-bf03-0a81f9a98c46 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.351530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d1b3-4662-4616-bf03-0a81f9a98c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.369973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bbf0d1b3-4662-4616-bf03-0a81f9a98c46 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:51.371150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bbf0d1b3-4662-4616-bf03-0a81f9a98c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:51.384645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48d04c-ae76-4a31-a73c-9f272fff7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:51.385301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48d04c-ae76-4a31-a73c-9f272fff7df4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.385584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48d04c-ae76-4a31-a73c-9f272fff7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.385845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48d04c-ae76-4a31-a73c-9f272fff7df4 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.386529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48d04c-ae76-4a31-a73c-9f272fff7df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:51.386824 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48d04c-ae76-4a31-a73c-9f272fff7df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:51.388171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48d04c-ae76-4a31-a73c-9f272fff7df4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:51.405542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 494/980] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:51.406547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48d04c-ae76-4a31-a73c-9f272fff7df4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:51.449051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 487/981] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:51.471528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d1b3-4662-4616-bf03-0a81f9a98c46 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:51.483808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:51.517322 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48d04c-ae76-4a31-a73c-9f272fff7df4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:51.550800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b68576-f7e2-49e6-96ab-f5ff71a1404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:51.551437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b68576-f7e2-49e6-96ab-f5ff71a1404c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.551715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b68576-f7e2-49e6-96ab-f5ff71a1404c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.551979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b68576-f7e2-49e6-96ab-f5ff71a1404c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.559147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b68576-f7e2-49e6-96ab-f5ff71a1404c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:51.560580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b68576-f7e2-49e6-96ab-f5ff71a1404c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:51.570784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d1b3-4662-4616-bf03-0a81f9a98c46 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c6b68576-f7e2-49e6-96ab-f5ff71a1404c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:51.571950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:51.572870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:51.574404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:51.574404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:51.574404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:51.574404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:51.574404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:51.574404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:51.574404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:51.574404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:51.574404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 495/982] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:51.575008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e663-c964-4381-b6d0-1a8f7b2fa83b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.575008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e663-c964-4381-b6d0-1a8f7b2fa83b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.575154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e663-c964-4381-b6d0-1a8f7b2fa83b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.576281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 496/983] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:51.581581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c2e68-8d6d-4ba7-8c0c-d24aba576bb1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.581860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c2e68-8d6d-4ba7-8c0c-d24aba576bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.582126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c2e68-8d6d-4ba7-8c0c-d24aba576bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.589281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:51.599745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9b0c2e68-8d6d-4ba7-8c0c-d24aba576bb1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:51.601512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9b0c2e68-8d6d-4ba7-8c0c-d24aba576bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:51.607631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc4bfa-0622-48fe-a3c7-560a977013da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:51.608266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4bfa-0622-48fe-a3c7-560a977013da None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.608546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4bfa-0622-48fe-a3c7-560a977013da None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.608817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4bfa-0622-48fe-a3c7-560a977013da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.609490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc4bfa-0622-48fe-a3c7-560a977013da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:51.610847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc4bfa-0622-48fe-a3c7-560a977013da None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-85dc4bfa-0622-48fe-a3c7-560a977013da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:51.620196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:51.621268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:51.622141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 488/984] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 05:20:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:51.623041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc4bfa-0622-48fe-a3c7-560a977013da None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:51.670152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 497/985] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:51.681318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c2e68-8d6d-4ba7-8c0c-d24aba576bb1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:51.698777 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:51.723167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc4bfa-0622-48fe-a3c7-560a977013da None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:51.756395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d3d53-7482-40cd-bcca-50e65cc63b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:51.757006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d3d53-7482-40cd-bcca-50e65cc63b90 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.757338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d3d53-7482-40cd-bcca-50e65cc63b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.757595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d3d53-7482-40cd-bcca-50e65cc63b90 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.758343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d3d53-7482-40cd-bcca-50e65cc63b90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:51.758650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d3d53-7482-40cd-bcca-50e65cc63b90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:51.760088 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d3d53-7482-40cd-bcca-50e65cc63b90 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:51.768200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c2e68-8d6d-4ba7-8c0c-d24aba576bb1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:51.771845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 489/986] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:51.773185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d3d53-7482-40cd-bcca-50e65cc63b90 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:51.804763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382410c-6884-4045-a751-45d2e7ad8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:51.805419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382410c-6884-4045-a751-45d2e7ad8135 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.805696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382410c-6884-4045-a751-45d2e7ad8135 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.805965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382410c-6884-4045-a751-45d2e7ad8135 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.806632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382410c-6884-4045-a751-45d2e7ad8135 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:51.806929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382410c-6884-4045-a751-45d2e7ad8135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:51.808277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382410c-6884-4045-a751-45d2e7ad8135 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:51.809323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:51.814381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 498/987] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 05:20:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:51.815861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382410c-6884-4045-a751-45d2e7ad8135 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:51.873185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d3d53-7482-40cd-bcca-50e65cc63b90 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:51.907978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15578c-a2df-4706-b1f2-e02aa2b60e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:51.908608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15578c-a2df-4706-b1f2-e02aa2b60e5d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.908886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15578c-a2df-4706-b1f2-e02aa2b60e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.909180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15578c-a2df-4706-b1f2-e02aa2b60e5d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.909805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15578c-a2df-4706-b1f2-e02aa2b60e5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:51.911168 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15578c-a2df-4706-b1f2-e02aa2b60e5d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:51.912878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:51.914456 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382410c-6884-4045-a751-45d2e7ad8135 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8b15578c-a2df-4706-b1f2-e02aa2b60e5d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:51.922117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:51.923185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:51.924065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 490/988] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:51.926380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15578c-a2df-4706-b1f2-e02aa2b60e5d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:51.949060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f9ea9-d02f-4c37-b7ff-8c5b78252c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:51.949707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f9ea9-d02f-4c37-b7ff-8c5b78252c2e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:51.949988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f9ea9-d02f-4c37-b7ff-8c5b78252c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:51.950260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f9ea9-d02f-4c37-b7ff-8c5b78252c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:51.951049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f9ea9-d02f-4c37-b7ff-8c5b78252c2e None admin] RBAC: Adding query filter params (role.id=64ab1a99959f496c9cca03b0df885dd6, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=c8577537a1a84cffb5d8aebc4f41e8e0) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:51.951359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f9ea9-d02f-4c37-b7ff-8c5b78252c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:51.952787 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f9ea9-d02f-4c37-b7ff-8c5b78252c2e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:51.958512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 499/989] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:51 2022] GET /identity/v3/role_assignments?user.id=c8577537a1a84cffb5d8aebc4f41e8e0&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=64ab1a99959f496c9cca03b0df885dd6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:51.959279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f9ea9-d02f-4c37-b7ff-8c5b78252c2e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:52.036732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:52.040581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15578c-a2df-4706-b1f2-e02aa2b60e5d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:52.079572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7298aa-bd6d-4720-91a0-7e202151b94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:52.080230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f9ea9-d02f-4c37-b7ff-8c5b78252c2e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:52.080316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7298aa-bd6d-4720-91a0-7e202151b94f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:52.080482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7298aa-bd6d-4720-91a0-7e202151b94f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:52.080756 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7298aa-bd6d-4720-91a0-7e202151b94f None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:52.081490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7298aa-bd6d-4720-91a0-7e202151b94f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:52.081802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7298aa-bd6d-4720-91a0-7e202151b94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:52.083205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7298aa-bd6d-4720-91a0-7e202151b94f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:52.088849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 491/990] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 05:20:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:52.094819 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7298aa-bd6d-4720-91a0-7e202151b94f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:52.119922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31136cce-c0be-450e-904b-8c682e12c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:52.120549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31136cce-c0be-450e-904b-8c682e12c33a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:52.120833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31136cce-c0be-450e-904b-8c682e12c33a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:52.121109 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31136cce-c0be-450e-904b-8c682e12c33a None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:52.122144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31136cce-c0be-450e-904b-8c682e12c33a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:52.122144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31136cce-c0be-450e-904b-8c682e12c33a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:52.123467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31136cce-c0be-450e-904b-8c682e12c33a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:52.128953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 500/991] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:52.134975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31136cce-c0be-450e-904b-8c682e12c33a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:52.179562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:52.221374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7298aa-bd6d-4720-91a0-7e202151b94f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:52.247543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31136cce-c0be-450e-904b-8c682e12c33a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:52.253988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e844866-d8b6-408a-9faf-3a0b2e489909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:52.254606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e844866-d8b6-408a-9faf-3a0b2e489909 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:52.254886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e844866-d8b6-408a-9faf-3a0b2e489909 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:52.255151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e844866-d8b6-408a-9faf-3a0b2e489909 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:52.255916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e844866-d8b6-408a-9faf-3a0b2e489909 None admin] RBAC: Adding query filter params (interface=admin, service_id=0c06c1f4d27147b5b642b53f8d7be7ae, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:52.256220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e844866-d8b6-408a-9faf-3a0b2e489909 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:52.258139 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e844866-d8b6-408a-9faf-3a0b2e489909 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:52.270135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 492/992] 10.222.0.42 () {56 vars in 1249 bytes} [Thu Jul 28 05:20:52 2022] GET /identity/v3/endpoints?service_id=0c06c1f4d27147b5b642b53f8d7be7ae&interface=admin®ion_id=RegionOne => generated 193 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:52.271245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e844866-d8b6-408a-9faf-3a0b2e489909 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:52.279768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:52.289550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51680fdd-77ec-495a-858a-027428e58430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:52.290392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680fdd-77ec-495a-858a-027428e58430 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:52.290610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680fdd-77ec-495a-858a-027428e58430 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:52.290929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680fdd-77ec-495a-858a-027428e58430 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:52.291814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680fdd-77ec-495a-858a-027428e58430 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:52.292115 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680fdd-77ec-495a-858a-027428e58430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:52.293553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680fdd-77ec-495a-858a-027428e58430 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:52.298880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 501/993] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:52.304960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51680fdd-77ec-495a-858a-027428e58430 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:52.376308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e844866-d8b6-408a-9faf-3a0b2e489909 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:52.403202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:52.409470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51680fdd-77ec-495a-858a-027428e58430 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:52.412622 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da995865-b2a6-4bff-99a3-4e242665c3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:52.413291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da995865-b2a6-4bff-99a3-4e242665c3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:52.413573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da995865-b2a6-4bff-99a3-4e242665c3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:52.413843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da995865-b2a6-4bff-99a3-4e242665c3c5 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:52.414498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da995865-b2a6-4bff-99a3-4e242665c3c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:52.415866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da995865-b2a6-4bff-99a3-4e242665c3c5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:52.433210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 493/994] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 05:20:52 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:20:52.448159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebf3fa-f33a-4ec9-a8f8-9b0b39d8583c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:52.448810 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf3fa-f33a-4ec9-a8f8-9b0b39d8583c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:52.449095 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf3fa-f33a-4ec9-a8f8-9b0b39d8583c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:52.449459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf3fa-f33a-4ec9-a8f8-9b0b39d8583c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:52.450256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebf3fa-f33a-4ec9-a8f8-9b0b39d8583c None admin] RBAC: Adding query filter params (interface=public, service_id=4af86e1d84bb42809b24ffe41d0b6be7, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:52.450568 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebf3fa-f33a-4ec9-a8f8-9b0b39d8583c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:52.451989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebf3fa-f33a-4ec9-a8f8-9b0b39d8583c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:52.462844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 502/995] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 05:20:52 2022] GET /identity/v3/endpoints?service_id=4af86e1d84bb42809b24ffe41d0b6be7&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:52.464218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da995865-b2a6-4bff-99a3-4e242665c3c5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:52.574290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da995865-b2a6-4bff-99a3-4e242665c3c5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:52.613599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0150b1-a7b5-436e-8b4e-e7db9ca5d6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:52.614223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0150b1-a7b5-436e-8b4e-e7db9ca5d6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:52.614504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0150b1-a7b5-436e-8b4e-e7db9ca5d6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:52.614779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0150b1-a7b5-436e-8b4e-e7db9ca5d6e9 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:52.615433 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0150b1-a7b5-436e-8b4e-e7db9ca5d6e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:52.617340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0150b1-a7b5-436e-8b4e-e7db9ca5d6e9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:52.624128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 494/996] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 05:20:52 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:20:54.029966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea2af-e33d-4c39-adef-dfa428ba9ad6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.030490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea2af-e33d-4c39-adef-dfa428ba9ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.030609 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea2af-e33d-4c39-adef-dfa428ba9ad6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.031894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 503/997] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:54.037058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58543fb-7fce-4e45-b91f-e0dcdc38391f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.037504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58543fb-7fce-4e45-b91f-e0dcdc38391f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.037668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58543fb-7fce-4e45-b91f-e0dcdc38391f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.056595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c58543fb-7fce-4e45-b91f-e0dcdc38391f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:54.057812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c58543fb-7fce-4e45-b91f-e0dcdc38391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:54.108824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:54.127342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 495/998] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:54.150140 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ea2af-e33d-4c39-adef-dfa428ba9ad6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:54.209408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:54.256220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ea2af-e33d-4c39-adef-dfa428ba9ad6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:54.290362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6bb12-7dab-45a5-9e1d-f2f781c27b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:54.291038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6bb12-7dab-45a5-9e1d-f2f781c27b63 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.291329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6bb12-7dab-45a5-9e1d-f2f781c27b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.291602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6bb12-7dab-45a5-9e1d-f2f781c27b63 None admin] PATH_INFO: `/v3/services/image` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.292231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6bb12-7dab-45a5-9e1d-f2f781c27b63 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:54.293626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6bb12-7dab-45a5-9e1d-f2f781c27b63 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fad6bb12-7dab-45a5-9e1d-f2f781c27b63 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:54.303011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:54.304755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:20:54.305691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:54.309458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 504/999] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 05:20:54 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:54.310997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58543fb-7fce-4e45-b91f-e0dcdc38391f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:54.410351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58543fb-7fce-4e45-b91f-e0dcdc38391f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:54.435093 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc341327-bc07-46ba-9355-dbf5e97e2f0f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.435370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc341327-bc07-46ba-9355-dbf5e97e2f0f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.435640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc341327-bc07-46ba-9355-dbf5e97e2f0f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.436961 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 505/1000] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:54.441966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aed88e-af93-4ecb-9abd-52358e62b51a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.447666 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aed88e-af93-4ecb-9abd-52358e62b51a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.447666 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aed88e-af93-4ecb-9abd-52358e62b51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.447834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74bcaa-44ee-44a4-ab99-7018fa4335c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:54.448543 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74bcaa-44ee-44a4-ab99-7018fa4335c8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.448988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74bcaa-44ee-44a4-ab99-7018fa4335c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.449416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74bcaa-44ee-44a4-ab99-7018fa4335c8 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.450250 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74bcaa-44ee-44a4-ab99-7018fa4335c8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:54.450552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74bcaa-44ee-44a4-ab99-7018fa4335c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:54.451915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74bcaa-44ee-44a4-ab99-7018fa4335c8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:54.461546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 496/1001] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:54.462766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74bcaa-44ee-44a4-ab99-7018fa4335c8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:54.466292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-26aed88e-af93-4ecb-9abd-52358e62b51a None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:54.467569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-26aed88e-af93-4ecb-9abd-52358e62b51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:54.515735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:54.536243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 506/1002] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:54.559754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aed88e-af93-4ecb-9abd-52358e62b51a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:54.573040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74bcaa-44ee-44a4-ab99-7018fa4335c8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:54.609505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:54.614305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3530a-0718-4d1b-9089-aaa0ebda1c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:54.619546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3530a-0718-4d1b-9089-aaa0ebda1c8f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.619546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3530a-0718-4d1b-9089-aaa0ebda1c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.619546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3530a-0718-4d1b-9089-aaa0ebda1c8f None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.619546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3530a-0718-4d1b-9089-aaa0ebda1c8f None admin] RBAC: Adding query filter params (type=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:54.619546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3530a-0718-4d1b-9089-aaa0ebda1c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:54.619546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3530a-0718-4d1b-9089-aaa0ebda1c8f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:54.623111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 497/1003] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:54.654502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ee103-4a67-4b68-81d6-1832888d3f1a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.654844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ee103-4a67-4b68-81d6-1832888d3f1a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.655056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ee103-4a67-4b68-81d6-1832888d3f1a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.656606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 498/1004] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:54.662075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e2149-de93-4d85-9b76-6984446249df None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.662362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e2149-de93-4d85-9b76-6984446249df None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.662638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e2149-de93-4d85-9b76-6984446249df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.668676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aed88e-af93-4ecb-9abd-52358e62b51a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:54.682827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-489e2149-de93-4d85-9b76-6984446249df None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:54.684057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-489e2149-de93-4d85-9b76-6984446249df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:54.709591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbb7a8-1e7c-454a-9233-0e5ce8bbf615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:54.710451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb7a8-1e7c-454a-9233-0e5ce8bbf615 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.710736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb7a8-1e7c-454a-9233-0e5ce8bbf615 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.711121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb7a8-1e7c-454a-9233-0e5ce8bbf615 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.711763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbb7a8-1e7c-454a-9233-0e5ce8bbf615 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:54.713173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbb7a8-1e7c-454a-9233-0e5ce8bbf615 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b9bbb7a8-1e7c-454a-9233-0e5ce8bbf615 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:54.722712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:54.723828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:54.724729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 507/1005] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 05:20:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:54.730464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbb7a8-1e7c-454a-9233-0e5ce8bbf615 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:54.763469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 499/1006] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:54.787055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e2149-de93-4d85-9b76-6984446249df None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:54.837436 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:54.848378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbb7a8-1e7c-454a-9233-0e5ce8bbf615 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:54.862618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:54.884984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2af9cb-788c-4e1c-a5bd-b783e939c0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:54.885662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2af9cb-788c-4e1c-a5bd-b783e939c0ae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.885944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2af9cb-788c-4e1c-a5bd-b783e939c0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.886223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2af9cb-788c-4e1c-a5bd-b783e939c0ae None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.886898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2af9cb-788c-4e1c-a5bd-b783e939c0ae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:54.887204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2af9cb-788c-4e1c-a5bd-b783e939c0ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:54.888567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2af9cb-788c-4e1c-a5bd-b783e939c0ae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:54.893964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 508/1007] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 05:20:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:54.899754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2af9cb-788c-4e1c-a5bd-b783e939c0ae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:54.904252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e2149-de93-4d85-9b76-6984446249df None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:54.942463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428773d-4c4f-4905-99b6-058014837d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:54.943109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428773d-4c4f-4905-99b6-058014837d4c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:54.943391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428773d-4c4f-4905-99b6-058014837d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:54.943665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428773d-4c4f-4905-99b6-058014837d4c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:54.944317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428773d-4c4f-4905-99b6-058014837d4c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:54.946009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428773d-4c4f-4905-99b6-058014837d4c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c428773d-4c4f-4905-99b6-058014837d4c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:54.955158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:54.956212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:54.957064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 500/1008] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:54.963119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428773d-4c4f-4905-99b6-058014837d4c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:55.004479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2af9cb-788c-4e1c-a5bd-b783e939c0ae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:55.040251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a109b-0121-43ab-a529-9769c547a51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:55.040876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a109b-0121-43ab-a529-9769c547a51f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:55.041163 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a109b-0121-43ab-a529-9769c547a51f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:55.041442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a109b-0121-43ab-a529-9769c547a51f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:55.042151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a109b-0121-43ab-a529-9769c547a51f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:55.042464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a109b-0121-43ab-a529-9769c547a51f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:55.043838 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a109b-0121-43ab-a529-9769c547a51f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:55.050143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 509/1009] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 05:20:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:55.055997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a109b-0121-43ab-a529-9769c547a51f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:55.073545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428773d-4c4f-4905-99b6-058014837d4c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:55.081510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:55.103736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:55.109367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b93065-c8e3-4f4f-a34a-b88bbd399217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:55.109981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b93065-c8e3-4f4f-a34a-b88bbd399217 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:55.110257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b93065-c8e3-4f4f-a34a-b88bbd399217 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:55.110526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b93065-c8e3-4f4f-a34a-b88bbd399217 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:55.111199 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b93065-c8e3-4f4f-a34a-b88bbd399217 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:55.111497 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b93065-c8e3-4f4f-a34a-b88bbd399217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:55.112856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b93065-c8e3-4f4f-a34a-b88bbd399217 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:55.123018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 501/1010] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:55.123918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b93065-c8e3-4f4f-a34a-b88bbd399217 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:55.173570 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a109b-0121-43ab-a529-9769c547a51f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:55.211209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5753f8c-e76d-45bf-8af6-fdb94b634cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:55.211961 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5753f8c-e76d-45bf-8af6-fdb94b634cc3 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:55.212210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5753f8c-e76d-45bf-8af6-fdb94b634cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:55.212480 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5753f8c-e76d-45bf-8af6-fdb94b634cc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:55.213201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5753f8c-e76d-45bf-8af6-fdb94b634cc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:55.214624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5753f8c-e76d-45bf-8af6-fdb94b634cc3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:55.235356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b93065-c8e3-4f4f-a34a-b88bbd399217 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:55.268941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2a509-9423-4e37-9821-568a895b9ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:55.269591 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a509-9423-4e37-9821-568a895b9ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:55.269873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a509-9423-4e37-9821-568a895b9ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:55.270145 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a509-9423-4e37-9821-568a895b9ed1 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:55.270824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2a509-9423-4e37-9821-568a895b9ed1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:55.271126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2a509-9423-4e37-9821-568a895b9ed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:55.272567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2a509-9423-4e37-9821-568a895b9ed1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:55.277348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 502/1011] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 05:20:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:55.282873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2a509-9423-4e37-9821-568a895b9ed1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:55.297557 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 510/1012] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:20:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:55.323152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:55.397085 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2a509-9423-4e37-9821-568a895b9ed1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:55.440162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36f773-b092-40db-8be2-5541c5bd8a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:55.440789 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36f773-b092-40db-8be2-5541c5bd8a12 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:55.441067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36f773-b092-40db-8be2-5541c5bd8a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:55.441380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36f773-b092-40db-8be2-5541c5bd8a12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:55.442110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36f773-b092-40db-8be2-5541c5bd8a12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:55.447474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36f773-b092-40db-8be2-5541c5bd8a12 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:55.564659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 503/1013] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:20:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:56.669095 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29160c-6ddf-48af-904e-89550616b619 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:56.669627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29160c-6ddf-48af-904e-89550616b619 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:56.669735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29160c-6ddf-48af-904e-89550616b619 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:56.671065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 511/1014] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:56.676352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd08d2-e1cd-4e99-b1c8-0cd592e30283 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:56.676781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd08d2-e1cd-4e99-b1c8-0cd592e30283 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:56.676930 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd08d2-e1cd-4e99-b1c8-0cd592e30283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:56.695545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ddbd08d2-e1cd-4e99-b1c8-0cd592e30283 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:56.696728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ddbd08d2-e1cd-4e99-b1c8-0cd592e30283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:56.777154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 504/1015] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:56 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:56.799235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29160c-6ddf-48af-904e-89550616b619 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:56.900232 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:56.904652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29160c-6ddf-48af-904e-89550616b619 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:56.938511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee28cf4-bf0c-4cec-9b55-216cbab9dd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:56.939114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28cf4-bf0c-4cec-9b55-216cbab9dd60 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:56.939387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28cf4-bf0c-4cec-9b55-216cbab9dd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:56.939652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28cf4-bf0c-4cec-9b55-216cbab9dd60 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:56.940345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee28cf4-bf0c-4cec-9b55-216cbab9dd60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:56.941721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee28cf4-bf0c-4cec-9b55-216cbab9dd60 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:57.050564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 512/1016] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:20:56 2022] POST /identity/v3/services => generated 242 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:57.334705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8106-bd9d-400f-8ade-5cd34d6fb187 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:57.336041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8106-bd9d-400f-8ade-5cd34d6fb187 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:57.336041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8106-bd9d-400f-8ade-5cd34d6fb187 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:57.337336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 505/1017] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:20:57.342383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732deb7-7a12-4b27-bee6-7c9e3f40e427 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:57.342676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732deb7-7a12-4b27-bee6-7c9e3f40e427 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:57.342953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732deb7-7a12-4b27-bee6-7c9e3f40e427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:57.361681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a732deb7-7a12-4b27-bee6-7c9e3f40e427 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:57.362865 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a732deb7-7a12-4b27-bee6-7c9e3f40e427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:57.439383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 513/1018] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:20:57.461921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c8106-bd9d-400f-8ade-5cd34d6fb187 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:57.477658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:57.567385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c8106-bd9d-400f-8ade-5cd34d6fb187 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:57.601819 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedaf24-7fe7-43f6-a57a-d5c69fcb5f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:57.602370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaf24-7fe7-43f6-a57a-d5c69fcb5f3b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:57.602648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaf24-7fe7-43f6-a57a-d5c69fcb5f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:57.602917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedaf24-7fe7-43f6-a57a-d5c69fcb5f3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:57.604075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedaf24-7fe7-43f6-a57a-d5c69fcb5f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:57.605540 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedaf24-7fe7-43f6-a57a-d5c69fcb5f3b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:57.615097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 506/1019] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:57.615244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732deb7-7a12-4b27-bee6-7c9e3f40e427 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:57.696676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b710d-21ea-408f-816d-ec96d9706ccd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:57.697219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b710d-21ea-408f-816d-ec96d9706ccd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:57.697339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b710d-21ea-408f-816d-ec96d9706ccd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:57.698600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 507/1020] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:57.703423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ba7de-4593-49d2-8930-971e326804eb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:57.703715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ba7de-4593-49d2-8930-971e326804eb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:57.703989 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ba7de-4593-49d2-8930-971e326804eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:57.705009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:57.722414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732deb7-7a12-4b27-bee6-7c9e3f40e427 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:57.722733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-af1ba7de-4593-49d2-8930-971e326804eb None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:57.723826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af1ba7de-4593-49d2-8930-971e326804eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:57.758936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ebfe7-8ec2-400a-b6ba-250a4a4cd59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:57.759562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ebfe7-8ec2-400a-b6ba-250a4a4cd59e None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:57.759843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ebfe7-8ec2-400a-b6ba-250a4a4cd59e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:57.760120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ebfe7-8ec2-400a-b6ba-250a4a4cd59e None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:57.760809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ebfe7-8ec2-400a-b6ba-250a4a4cd59e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:57.762325 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ebfe7-8ec2-400a-b6ba-250a4a4cd59e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:57.793890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 508/1021] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:57.817140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ba7de-4593-49d2-8930-971e326804eb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:57.830124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:57.880424 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 514/1022] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:20:57 2022] POST /identity/v3/projects => generated 311 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:20:57.932845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ba7de-4593-49d2-8930-971e326804eb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:57.970266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d349c-a470-4bee-b1d2-cf4f1b04a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:57.970917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d349c-a470-4bee-b1d2-cf4f1b04a09e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:57.971195 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d349c-a470-4bee-b1d2-cf4f1b04a09e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:57.971460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d349c-a470-4bee-b1d2-cf4f1b04a09e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:57.983536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d349c-a470-4bee-b1d2-cf4f1b04a09e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-826d349c-a470-4bee-b1d2-cf4f1b04a09e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:20:57.988440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:57.989711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:57.990590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 509/1023] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 05:20:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:57.996245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ebfe7-8ec2-400a-b6ba-250a4a4cd59e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:58.105160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ebfe7-8ec2-400a-b6ba-250a4a4cd59e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:58.139945 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dac08-23eb-4d90-b4fa-db04c2e20287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:58.140485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dac08-23eb-4d90-b4fa-db04c2e20287 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:58.140759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dac08-23eb-4d90-b4fa-db04c2e20287 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:58.141027 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dac08-23eb-4d90-b4fa-db04c2e20287 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:58.141773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dac08-23eb-4d90-b4fa-db04c2e20287 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:58.142072 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dac08-23eb-4d90-b4fa-db04c2e20287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:58.143425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dac08-23eb-4d90-b4fa-db04c2e20287 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:58.148723 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:58.152490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 515/1024] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 05:20:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:58.158087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d349c-a470-4bee-b1d2-cf4f1b04a09e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:58.239484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:58.272414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d349c-a470-4bee-b1d2-cf4f1b04a09e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:58.308138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb82eb9-65d5-4fc9-b13a-169ebdffe2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:58.308865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb82eb9-65d5-4fc9-b13a-169ebdffe2af None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:58.309247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb82eb9-65d5-4fc9-b13a-169ebdffe2af None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:58.309588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb82eb9-65d5-4fc9-b13a-169ebdffe2af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:58.320169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb82eb9-65d5-4fc9-b13a-169ebdffe2af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:58.321720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb82eb9-65d5-4fc9-b13a-169ebdffe2af None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-edb82eb9-65d5-4fc9-b13a-169ebdffe2af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:58.336306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:58.337468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:58.338718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:58.338718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:58.338718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:58.338718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:58.343858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 510/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:58.344898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dac08-23eb-4d90-b4fa-db04c2e20287 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:58.448168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dac08-23eb-4d90-b4fa-db04c2e20287 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:58.482916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59006436-5b5d-48f4-bf66-ff99d354ae51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:58.483537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59006436-5b5d-48f4-bf66-ff99d354ae51 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:58.483819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59006436-5b5d-48f4-bf66-ff99d354ae51 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:58.484093 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59006436-5b5d-48f4-bf66-ff99d354ae51 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:58.484777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59006436-5b5d-48f4-bf66-ff99d354ae51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:58.485082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59006436-5b5d-48f4-bf66-ff99d354ae51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:58.486502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59006436-5b5d-48f4-bf66-ff99d354ae51 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:58.502573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 516/1026] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:58.503895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb82eb9-65d5-4fc9-b13a-169ebdffe2af None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:58.606025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb82eb9-65d5-4fc9-b13a-169ebdffe2af None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:58.628590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:58.641222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6e93-3b3d-4ae7-86ea-47fccc58b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:58.641869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6e93-3b3d-4ae7-86ea-47fccc58b4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:58.642151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6e93-3b3d-4ae7-86ea-47fccc58b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:58.642425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca6e93-3b3d-4ae7-86ea-47fccc58b4d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:58.650552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca6e93-3b3d-4ae7-86ea-47fccc58b4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:58.651996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca6e93-3b3d-4ae7-86ea-47fccc58b4d7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b5ca6e93-3b3d-4ae7-86ea-47fccc58b4d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:20:58.663722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:58.664715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:58.672307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:58.672307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:58.672307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:20:58.672307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:20:58.672307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:20:58.672307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:20:58.672307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:20:58.672307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:20:58.672307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:20:58.672307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:58.672307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 511/1027] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 05:20:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:58.673080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59006436-5b5d-48f4-bf66-ff99d354ae51 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:58.734700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:58.778770 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59006436-5b5d-48f4-bf66-ff99d354ae51 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:58.811918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0f99c-240a-4000-b4b3-93856357b18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:58.812543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f99c-240a-4000-b4b3-93856357b18a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:58.812823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f99c-240a-4000-b4b3-93856357b18a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:58.813094 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0f99c-240a-4000-b4b3-93856357b18a None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:58.813916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0f99c-240a-4000-b4b3-93856357b18a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:58.814222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0f99c-240a-4000-b4b3-93856357b18a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:58.815643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0f99c-240a-4000-b4b3-93856357b18a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:58.838499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 517/1028] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 05:20:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:20:58.839695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6e93-3b3d-4ae7-86ea-47fccc58b4d7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:58.938748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca6e93-3b3d-4ae7-86ea-47fccc58b4d7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:58.972363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dcea2-6744-43c6-a68f-f89f930d1ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:58.972978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dcea2-6744-43c6-a68f-f89f930d1ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:58.973288 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dcea2-6744-43c6-a68f-f89f930d1ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:58.973562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dcea2-6744-43c6-a68f-f89f930d1ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:59.024460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:59.042705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dcea2-6744-43c6-a68f-f89f930d1ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:59.044167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dcea2-6744-43c6-a68f-f89f930d1ff9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:59.135442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4028df-604b-4618-bd1e-a9bbb4a8a3f7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:59.135794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4028df-604b-4618-bd1e-a9bbb4a8a3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:59.136007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4028df-604b-4618-bd1e-a9bbb4a8a3f7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:59.137494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 518/1029] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:20:59.141977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ce2f-1418-437e-9196-04398ec83cd4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:59.142270 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ce2f-1418-437e-9196-04398ec83cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:59.142531 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ce2f-1418-437e-9196-04398ec83cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:59.153168 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 512/1030] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:20:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 05:20:59.155682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dcea2-6744-43c6-a68f-f89f930d1ff9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:59.160896 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fe11ce2f-1418-437e-9196-04398ec83cd4 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:20:59.162097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fe11ce2f-1418-437e-9196-04398ec83cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:20:59.235287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 519/1031] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:20:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:20:59.245639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:59.259543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11ce2f-1418-437e-9196-04398ec83cd4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:59.265156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dcea2-6744-43c6-a68f-f89f930d1ff9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:59.300699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aa2ef-5b76-4adf-892f-3a4c3690bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:59.301284 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa2ef-5b76-4adf-892f-3a4c3690bf7e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:59.301562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa2ef-5b76-4adf-892f-3a4c3690bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:59.301832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa2ef-5b76-4adf-892f-3a4c3690bf7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:59.313395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04aa2ef-5b76-4adf-892f-3a4c3690bf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:59.315153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04aa2ef-5b76-4adf-892f-3a4c3690bf7e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:59.320422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f04aa2ef-5b76-4adf-892f-3a4c3690bf7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:20:59.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:59.333577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:59.335171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:20:59.335171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:20:59.335171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:20:59.335171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:59.335171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 513/1032] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:59.338373 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aa2ef-5b76-4adf-892f-3a4c3690bf7e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:59.379100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11ce2f-1418-437e-9196-04398ec83cd4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:59.418819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ffad6-36ef-4661-a6ca-4e8f70188d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:59.419470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ffad6-36ef-4661-a6ca-4e8f70188d12 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:59.419753 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ffad6-36ef-4661-a6ca-4e8f70188d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:59.420380 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ffad6-36ef-4661-a6ca-4e8f70188d12 None admin] PATH_INFO: `/v3/services/image` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:59.421022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ffad6-36ef-4661-a6ca-4e8f70188d12 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:59.423069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ffad6-36ef-4661-a6ca-4e8f70188d12 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b05ffad6-36ef-4661-a6ca-4e8f70188d12 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:59.435302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:59.436312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:20:59.437449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 520/1033] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 05:20:59 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:20:59.442869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ffad6-36ef-4661-a6ca-4e8f70188d12 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:59.449085 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aa2ef-5b76-4adf-892f-3a4c3690bf7e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:59.487428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10921c-425f-46ab-9f07-e3c42660057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:59.488117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10921c-425f-46ab-9f07-e3c42660057b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:59.488426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10921c-425f-46ab-9f07-e3c42660057b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:59.488702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10921c-425f-46ab-9f07-e3c42660057b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:59.489435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10921c-425f-46ab-9f07-e3c42660057b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:59.489740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10921c-425f-46ab-9f07-e3c42660057b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:59.492039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10921c-425f-46ab-9f07-e3c42660057b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:59.493852 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:59.506972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 514/1034] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:59.512550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10921c-425f-46ab-9f07-e3c42660057b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:59.555714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ffad6-36ef-4661-a6ca-4e8f70188d12 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:59.569166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:59.591154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc49cb-8623-400b-835b-3dc80d3f056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:59.591948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc49cb-8623-400b-835b-3dc80d3f056f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:59.592309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc49cb-8623-400b-835b-3dc80d3f056f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:59.592651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc49cb-8623-400b-835b-3dc80d3f056f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:59.593432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc49cb-8623-400b-835b-3dc80d3f056f None admin] RBAC: Adding query filter params (name=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:59.593801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc49cb-8623-400b-835b-3dc80d3f056f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:59.595235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc49cb-8623-400b-835b-3dc80d3f056f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:59.600223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 521/1035] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:59.606400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc49cb-8623-400b-835b-3dc80d3f056f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:59.623986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10921c-425f-46ab-9f07-e3c42660057b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:59.661409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28495e86-5ef2-4ff5-a625-cd41f5d791b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:59.662252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495e86-5ef2-4ff5-a625-cd41f5d791b3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:59.662616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495e86-5ef2-4ff5-a625-cd41f5d791b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:59.663613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495e86-5ef2-4ff5-a625-cd41f5d791b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:59.670826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28495e86-5ef2-4ff5-a625-cd41f5d791b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:59.672344 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28495e86-5ef2-4ff5-a625-cd41f5d791b3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-28495e86-5ef2-4ff5-a625-cd41f5d791b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:20:59.684485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:20:59.685677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:20:59.686865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:20:59.686865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:20:59.686865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:20:59.686865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:20:59.686865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:20:59.686865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:20:59.686865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:20:59.686865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:20:59.687913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 515/1036] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:20:59.693351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28495e86-5ef2-4ff5-a625-cd41f5d791b3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:59.714499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc49cb-8623-400b-835b-3dc80d3f056f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:59.750251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:59.751328 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e461f4-c110-4c18-b9ce-65e221275cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:59.751950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e461f4-c110-4c18-b9ce-65e221275cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:59.752239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e461f4-c110-4c18-b9ce-65e221275cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:59.752504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e461f4-c110-4c18-b9ce-65e221275cf6 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:59.753203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e461f4-c110-4c18-b9ce-65e221275cf6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:59.753514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e461f4-c110-4c18-b9ce-65e221275cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:59.754919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e461f4-c110-4c18-b9ce-65e221275cf6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:59.764873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 522/1037] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:20:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:59.766061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e461f4-c110-4c18-b9ce-65e221275cf6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:59.798860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28495e86-5ef2-4ff5-a625-cd41f5d791b3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:59.811307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:20:59.840584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddacf24-6710-4ab4-8a5c-5d9c07ed5569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:59.841241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddacf24-6710-4ab4-8a5c-5d9c07ed5569 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:59.841531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddacf24-6710-4ab4-8a5c-5d9c07ed5569 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:59.841801 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddacf24-6710-4ab4-8a5c-5d9c07ed5569 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:59.842558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddacf24-6710-4ab4-8a5c-5d9c07ed5569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:59.842863 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddacf24-6710-4ab4-8a5c-5d9c07ed5569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:59.844303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddacf24-6710-4ab4-8a5c-5d9c07ed5569 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:59.856364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 516/1038] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:20:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:59.862300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddacf24-6710-4ab4-8a5c-5d9c07ed5569 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:59.883773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e461f4-c110-4c18-b9ce-65e221275cf6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:59.921237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5f682-e78c-49d8-b3d7-4e65b43dd1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:20:59.921881 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5f682-e78c-49d8-b3d7-4e65b43dd1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:20:59.922179 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5f682-e78c-49d8-b3d7-4e65b43dd1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:20:59.922397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5f682-e78c-49d8-b3d7-4e65b43dd1e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:20:59.923262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5f682-e78c-49d8-b3d7-4e65b43dd1e8 None admin] RBAC: Adding query filter params (interface=public, service_id=801df37fdca740c0a17d575a7a7777af, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:20:59.923454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5f682-e78c-49d8-b3d7-4e65b43dd1e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:20:59.925062 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5f682-e78c-49d8-b3d7-4e65b43dd1e8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:20:59.935234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 523/1039] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 05:20:59 2022] GET /identity/v3/endpoints?service_id=801df37fdca740c0a17d575a7a7777af&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:20:59.936279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5f682-e78c-49d8-b3d7-4e65b43dd1e8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:20:59.972340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddacf24-6710-4ab4-8a5c-5d9c07ed5569 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:20:59.986344 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:00.006446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ad4ab-eb23-4424-8af8-8d039d0ec85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:00.007710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ad4ab-eb23-4424-8af8-8d039d0ec85c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:00.007984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ad4ab-eb23-4424-8af8-8d039d0ec85c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:00.008253 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ad4ab-eb23-4424-8af8-8d039d0ec85c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:00.009045 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ad4ab-eb23-4424-8af8-8d039d0ec85c None admin] RBAC: Adding query filter params (role.id=64ab1a99959f496c9cca03b0df885dd6, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=531ebc9dee0440888b94a6bf17d7a335) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:00.009765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ad4ab-eb23-4424-8af8-8d039d0ec85c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:00.011499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ad4ab-eb23-4424-8af8-8d039d0ec85c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:00.017244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 517/1040] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:20:59 2022] GET /identity/v3/role_assignments?user.id=531ebc9dee0440888b94a6bf17d7a335&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=64ab1a99959f496c9cca03b0df885dd6 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:00.018441 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799357-b9ed-4c96-ba5e-2c790abeb12d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:00.018692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799357-b9ed-4c96-ba5e-2c790abeb12d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:00.018961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799357-b9ed-4c96-ba5e-2c790abeb12d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:00.020178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 518/1041] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:00.030900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ccc0f-f6ef-4141-93cf-b1176e7e1756 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:00.031182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ccc0f-f6ef-4141-93cf-b1176e7e1756 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:00.031634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ccc0f-f6ef-4141-93cf-b1176e7e1756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:00.051787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-de7ccc0f-f6ef-4141-93cf-b1176e7e1756 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:00.053019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-de7ccc0f-f6ef-4141-93cf-b1176e7e1756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:00.059180 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5f682-e78c-49d8-b3d7-4e65b43dd1e8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:00.063191 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:00.098880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d38a34-62d1-438c-9bde-df75056d1792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:00.099514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d38a34-62d1-438c-9bde-df75056d1792 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:00.099793 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d38a34-62d1-438c-9bde-df75056d1792 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:00.100067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d38a34-62d1-438c-9bde-df75056d1792 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:00.101527 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d38a34-62d1-438c-9bde-df75056d1792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:00.102937 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d38a34-62d1-438c-9bde-df75056d1792 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:00.110331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 524/1042] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 05:20:59 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:21:00.140082 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 519/1043] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:21:00.173877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d38a34-62d1-438c-9bde-df75056d1792 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:00.285560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d38a34-62d1-438c-9bde-df75056d1792 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:00.321204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410828a-9423-4170-aefa-8b897bbbab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:00.321765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410828a-9423-4170-aefa-8b897bbbab29 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:00.322039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410828a-9423-4170-aefa-8b897bbbab29 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:00.322305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410828a-9423-4170-aefa-8b897bbbab29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:00.323428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410828a-9423-4170-aefa-8b897bbbab29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:00.324849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410828a-9423-4170-aefa-8b897bbbab29 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:00.330951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 525/1044] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:21:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:00.332451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ccc0f-f6ef-4141-93cf-b1176e7e1756 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:00.431558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ccc0f-f6ef-4141-93cf-b1176e7e1756 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:00.442009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:00.466341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815943f0-faf3-43b1-94c2-ff624ab74be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:00.466950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815943f0-faf3-43b1-94c2-ff624ab74be3 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:00.467226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815943f0-faf3-43b1-94c2-ff624ab74be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:00.467492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815943f0-faf3-43b1-94c2-ff624ab74be3 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:00.468176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815943f0-faf3-43b1-94c2-ff624ab74be3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:00.469629 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815943f0-faf3-43b1-94c2-ff624ab74be3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:00.554783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 520/1045] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:21:00 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:21:02.036380 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59751a65-06f9-4d77-82f1-c8743b3fbb1b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.036901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59751a65-06f9-4d77-82f1-c8743b3fbb1b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.036901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59751a65-06f9-4d77-82f1-c8743b3fbb1b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.039379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 526/1046] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:02.044945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae8d70-bb87-4834-ad5f-31609f5e03d7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.045437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae8d70-bb87-4834-ad5f-31609f5e03d7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.045526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae8d70-bb87-4834-ad5f-31609f5e03d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.065559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-55ae8d70-bb87-4834-ad5f-31609f5e03d7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:02.066755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-55ae8d70-bb87-4834-ad5f-31609f5e03d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:02.136064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 521/1047] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:21:02.149458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4f55-e20b-452b-b484-2bf682faf439 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.149745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4f55-e20b-452b-b484-2bf682faf439 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.150021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4f55-e20b-452b-b484-2bf682faf439 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.151356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 527/1048] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:02.158565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9619f1-9414-4f5b-a33b-eb6944de3845 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.158565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9619f1-9414-4f5b-a33b-eb6944de3845 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.158565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9619f1-9414-4f5b-a33b-eb6944de3845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.159755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff4f55-e20b-452b-b484-2bf682faf439 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:02.176214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ca9619f1-9414-4f5b-a33b-eb6944de3845 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:02.177440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ca9619f1-9414-4f5b-a33b-eb6944de3845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:02.201502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:02.252167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 522/1049] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:02.270025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff4f55-e20b-452b-b484-2bf682faf439 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:02.274314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9619f1-9414-4f5b-a33b-eb6944de3845 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:02.301881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:02.309737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03031b43-2d3c-43fe-8540-0ce3521117c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:02.310571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031b43-2d3c-43fe-8540-0ce3521117c1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.310998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031b43-2d3c-43fe-8540-0ce3521117c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.311584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031b43-2d3c-43fe-8540-0ce3521117c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.324878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03031b43-2d3c-43fe-8540-0ce3521117c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-03031b43-2d3c-43fe-8540-0ce3521117c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:21:02.329970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:02.330952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:21:02.331830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 528/1050] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 05:21:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:02.338522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03031b43-2d3c-43fe-8540-0ce3521117c1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:02.386767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9619f1-9414-4f5b-a33b-eb6944de3845 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:02.422731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f9ded-46ef-4441-807c-3c9329e55556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:02.423494 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f9ded-46ef-4441-807c-3c9329e55556 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.423774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f9ded-46ef-4441-807c-3c9329e55556 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.424312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f9ded-46ef-4441-807c-3c9329e55556 None admin] PATH_INFO: `/v3/services/image` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.424941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f9ded-46ef-4441-807c-3c9329e55556 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:02.426486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f9ded-46ef-4441-807c-3c9329e55556 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:02.436483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-856f9ded-46ef-4441-807c-3c9329e55556 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:02.437725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:02.438806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:02.440385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 523/1051] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 05:21:02 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:21:02.446052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f9ded-46ef-4441-807c-3c9329e55556 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:02.447147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03031b43-2d3c-43fe-8540-0ce3521117c1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:02.483731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf8e4f-db69-4cd8-af50-17ec59d84a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:02.484585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf8e4f-db69-4cd8-af50-17ec59d84a43 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.488383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf8e4f-db69-4cd8-af50-17ec59d84a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.488383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf8e4f-db69-4cd8-af50-17ec59d84a43 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.488383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf8e4f-db69-4cd8-af50-17ec59d84a43 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:02.488383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf8e4f-db69-4cd8-af50-17ec59d84a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:02.488383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf8e4f-db69-4cd8-af50-17ec59d84a43 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:02.497465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 529/1052] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 05:21:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:02.502958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf8e4f-db69-4cd8-af50-17ec59d84a43 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:02.543030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:02.556416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f9ded-46ef-4441-807c-3c9329e55556 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:02.592896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0499e0-6b55-4a84-ae52-fd86fd05414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:02.593550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0499e0-6b55-4a84-ae52-fd86fd05414f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.593831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0499e0-6b55-4a84-ae52-fd86fd05414f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.594099 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0499e0-6b55-4a84-ae52-fd86fd05414f None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.594785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0499e0-6b55-4a84-ae52-fd86fd05414f None admin] RBAC: Adding query filter params (name=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:02.595089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0499e0-6b55-4a84-ae52-fd86fd05414f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:02.596455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0499e0-6b55-4a84-ae52-fd86fd05414f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:02.606700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 524/1053] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:21:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:02.608042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0499e0-6b55-4a84-ae52-fd86fd05414f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:02.610285 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf8e4f-db69-4cd8-af50-17ec59d84a43 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:02.651543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7d1ed-5ca5-45fb-8fcc-e0fc6eab9683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:02.652181 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7d1ed-5ca5-45fb-8fcc-e0fc6eab9683 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.652461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7d1ed-5ca5-45fb-8fcc-e0fc6eab9683 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.652728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7d1ed-5ca5-45fb-8fcc-e0fc6eab9683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.664020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7d1ed-5ca5-45fb-8fcc-e0fc6eab9683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:02.665483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7d1ed-5ca5-45fb-8fcc-e0fc6eab9683 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-77f7d1ed-5ca5-45fb-8fcc-e0fc6eab9683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:21:02.680558 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:02.681829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:02.682778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:21:02.682778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:21:02.682778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:21:02.682778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:21:02.682778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 530/1054] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:21:02.683074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f3a1-f8ac-4809-b565-a05b08afcb4f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.683182 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f3a1-f8ac-4809-b565-a05b08afcb4f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.683458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6f3a1-f8ac-4809-b565-a05b08afcb4f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.684701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 531/1055] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:02.687697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6f3a1-f8ac-4809-b565-a05b08afcb4f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:02.700267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:02.708670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0499e0-6b55-4a84-ae52-fd86fd05414f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:02.743128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59fcdc-9f62-4acc-8e87-7cbd38767959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:02.743750 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59fcdc-9f62-4acc-8e87-7cbd38767959 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.744031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59fcdc-9f62-4acc-8e87-7cbd38767959 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.744305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59fcdc-9f62-4acc-8e87-7cbd38767959 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.744983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59fcdc-9f62-4acc-8e87-7cbd38767959 None admin] RBAC: Adding query filter params (type=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:02.745319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59fcdc-9f62-4acc-8e87-7cbd38767959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:02.746690 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59fcdc-9f62-4acc-8e87-7cbd38767959 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:02.751410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 525/1056] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:21:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:02.752532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90699-f2c8-4129-a388-64cbf3412c0d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.752833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90699-f2c8-4129-a388-64cbf3412c0d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.753095 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90699-f2c8-4129-a388-64cbf3412c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.771089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-63c90699-f2c8-4129-a388-64cbf3412c0d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:02.772419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-63c90699-f2c8-4129-a388-64cbf3412c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:02.783154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:02.789075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6f3a1-f8ac-4809-b565-a05b08afcb4f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:02.822957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3e215-4a43-49ca-86a3-573956450afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:02.823500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3e215-4a43-49ca-86a3-573956450afc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.823778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3e215-4a43-49ca-86a3-573956450afc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.824048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3e215-4a43-49ca-86a3-573956450afc None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.824730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3e215-4a43-49ca-86a3-573956450afc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:02.825031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3e215-4a43-49ca-86a3-573956450afc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:02.826423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3e215-4a43-49ca-86a3-573956450afc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:02.838077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 532/1057] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:02.839032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3e215-4a43-49ca-86a3-573956450afc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:02.853156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 526/1058] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:02.854560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90699-f2c8-4129-a388-64cbf3412c0d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:02.908015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:02.939486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3e215-4a43-49ca-86a3-573956450afc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:02.954867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90699-f2c8-4129-a388-64cbf3412c0d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:02.973989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227edfda-81f5-4339-ba76-5d7f0e799b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:02.974608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227edfda-81f5-4339-ba76-5d7f0e799b81 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.974884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227edfda-81f5-4339-ba76-5d7f0e799b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.976075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227edfda-81f5-4339-ba76-5d7f0e799b81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.976785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227edfda-81f5-4339-ba76-5d7f0e799b81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:02.978172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227edfda-81f5-4339-ba76-5d7f0e799b81 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:02.989363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404f85a-f54d-4c7c-8ee7-e314d1dfd9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:02.989998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404f85a-f54d-4c7c-8ee7-e314d1dfd9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:02.990271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404f85a-f54d-4c7c-8ee7-e314d1dfd9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:02.990536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404f85a-f54d-4c7c-8ee7-e314d1dfd9e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:02.997504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404f85a-f54d-4c7c-8ee7-e314d1dfd9e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:02.998930 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404f85a-f54d-4c7c-8ee7-e314d1dfd9e8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f404f85a-f54d-4c7c-8ee7-e314d1dfd9e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:21:03.010291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:03.011422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 527/1059] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 05:21:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:21:03.012523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404f85a-f54d-4c7c-8ee7-e314d1dfd9e8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:03.020413 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:03.056319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 533/1060] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:21:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:21:03.057110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227edfda-81f5-4339-ba76-5d7f0e799b81 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:03.120400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404f85a-f54d-4c7c-8ee7-e314d1dfd9e8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:03.170971 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ef059-f0ec-4f35-8d39-4d58aaba86c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:03.171635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ef059-f0ec-4f35-8d39-4d58aaba86c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:03.171912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ef059-f0ec-4f35-8d39-4d58aaba86c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:03.172188 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ef059-f0ec-4f35-8d39-4d58aaba86c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:03.185728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ef059-f0ec-4f35-8d39-4d58aaba86c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-337ef059-f0ec-4f35-8d39-4d58aaba86c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:21:03.190708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:03.191776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:03.193322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 528/1061] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:21:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:03.195649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227edfda-81f5-4339-ba76-5d7f0e799b81 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:03.198104 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ef059-f0ec-4f35-8d39-4d58aaba86c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:03.228501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:03.240702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2612ac-6f13-4e24-9207-b0f7aaf0dabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:03.241425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2612ac-6f13-4e24-9207-b0f7aaf0dabe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:03.241709 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2612ac-6f13-4e24-9207-b0f7aaf0dabe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:03.242435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2612ac-6f13-4e24-9207-b0f7aaf0dabe None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:03.243249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2612ac-6f13-4e24-9207-b0f7aaf0dabe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:03.243763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2612ac-6f13-4e24-9207-b0f7aaf0dabe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:03.245796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2612ac-6f13-4e24-9207-b0f7aaf0dabe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:03.267440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 534/1062] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 05:21:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:03.269642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:03.273562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2612ac-6f13-4e24-9207-b0f7aaf0dabe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:03.311417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ef059-f0ec-4f35-8d39-4d58aaba86c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:03.352781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a7642-255f-418e-a8c0-2d4af21223ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:03.353437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a7642-255f-418e-a8c0-2d4af21223ac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:03.353719 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a7642-255f-418e-a8c0-2d4af21223ac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:03.353991 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a7642-255f-418e-a8c0-2d4af21223ac None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:03.354713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a7642-255f-418e-a8c0-2d4af21223ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:03.355022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a7642-255f-418e-a8c0-2d4af21223ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:03.356395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a7642-255f-418e-a8c0-2d4af21223ac None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:03.366201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 529/1063] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:21:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:03.371805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a7642-255f-418e-a8c0-2d4af21223ac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:03.388371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2612ac-6f13-4e24-9207-b0f7aaf0dabe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:03.424907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bf8bd-32b6-4753-952c-ba8f86bb0adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:03.425583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bf8bd-32b6-4753-952c-ba8f86bb0adc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:03.425865 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bf8bd-32b6-4753-952c-ba8f86bb0adc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:03.426139 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bf8bd-32b6-4753-952c-ba8f86bb0adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:03.437407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bf8bd-32b6-4753-952c-ba8f86bb0adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:03.438939 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bf8bd-32b6-4753-952c-ba8f86bb0adc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-684bf8bd-32b6-4753-952c-ba8f86bb0adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:21:03.454469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:03.455423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:03.456349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:21:03.456349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:21:03.456349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:21:03.456349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:21:03.456349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 535/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:21:03.461561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bf8bd-32b6-4753-952c-ba8f86bb0adc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:03.484551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a7642-255f-418e-a8c0-2d4af21223ac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:03.499733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:03.510820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:03.522178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e533-50ca-49c3-b0e3-0a9f4801bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:03.522826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e533-50ca-49c3-b0e3-0a9f4801bed0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:03.523159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e533-50ca-49c3-b0e3-0a9f4801bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:03.523430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e533-50ca-49c3-b0e3-0a9f4801bed0 None admin] PATH_INFO: `/v3/users/438563771286452a93fd5d7572592f7f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:03.537322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0e533-50ca-49c3-b0e3-0a9f4801bed0 None admin] RBAC: Authorizing `identity:get_user(user_id=438563771286452a93fd5d7572592f7f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:03.539305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0e533-50ca-49c3-b0e3-0a9f4801bed0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:03.541689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 530/1065] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:03 2022] GET /identity/v3/users/438563771286452a93fd5d7572592f7f => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:03.548367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e533-50ca-49c3-b0e3-0a9f4801bed0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:03.574683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bf8bd-32b6-4753-952c-ba8f86bb0adc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:03.610576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c36674-184d-4bb0-9a01-d05ce5f68505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:03.611187 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c36674-184d-4bb0-9a01-d05ce5f68505 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:03.611470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c36674-184d-4bb0-9a01-d05ce5f68505 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:03.611747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c36674-184d-4bb0-9a01-d05ce5f68505 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:03.612447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c36674-184d-4bb0-9a01-d05ce5f68505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:03.612752 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c36674-184d-4bb0-9a01-d05ce5f68505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:03.614152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c36674-184d-4bb0-9a01-d05ce5f68505 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:03.626542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 536/1066] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:03.632948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c36674-184d-4bb0-9a01-d05ce5f68505 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:03.660873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e533-50ca-49c3-b0e3-0a9f4801bed0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:03.704497 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad582a-083e-4a03-98f8-b0c355231325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:03.705245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad582a-083e-4a03-98f8-b0c355231325 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:03.705528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad582a-083e-4a03-98f8-b0c355231325 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:03.705802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad582a-083e-4a03-98f8-b0c355231325 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:03.732681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:03.738363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c36674-184d-4bb0-9a01-d05ce5f68505 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:03.763808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:03.773541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22640a96-5bff-4739-9407-26a3cf95bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:03.774203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640a96-5bff-4739-9407-26a3cf95bffa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:03.774480 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640a96-5bff-4739-9407-26a3cf95bffa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:03.774773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640a96-5bff-4739-9407-26a3cf95bffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:03.781679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22640a96-5bff-4739-9407-26a3cf95bffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:03.782185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad582a-083e-4a03-98f8-b0c355231325 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:03.783116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22640a96-5bff-4739-9407-26a3cf95bffa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:03.784246 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad582a-083e-4a03-98f8-b0c355231325 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-22640a96-5bff-4739-9407-26a3cf95bffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:21:03.794524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:03.795473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:03.796403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:21:03.796403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:21:03.796403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:21:03.796403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:21:03.796403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:21:03.796403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:21:03.796403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:21:03.796403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:21:03.796403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 537/1067] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:21:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:21:03.801544 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22640a96-5bff-4739-9407-26a3cf95bffa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:03.900225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 531/1068] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:21:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 05:21:03.905862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad582a-083e-4a03-98f8-b0c355231325 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:03.911871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22640a96-5bff-4739-9407-26a3cf95bffa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:03.952485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e325b-7852-4641-ad1d-5df3289c7a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:03.953116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e325b-7852-4641-ad1d-5df3289c7a68 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:03.953421 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e325b-7852-4641-ad1d-5df3289c7a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:03.953723 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e325b-7852-4641-ad1d-5df3289c7a68 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:03.954438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e325b-7852-4641-ad1d-5df3289c7a68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:03.954743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e325b-7852-4641-ad1d-5df3289c7a68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:03.956164 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e325b-7852-4641-ad1d-5df3289c7a68 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:03.968287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 538/1069] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:21:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:03.973908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e325b-7852-4641-ad1d-5df3289c7a68 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:03.993445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:03.998114 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:04.016856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad582a-083e-4a03-98f8-b0c355231325 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:04.054357 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b9829-d3c1-4b49-9cfc-fff54ef443a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:04.055175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b9829-d3c1-4b49-9cfc-fff54ef443a6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:04.055526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b9829-d3c1-4b49-9cfc-fff54ef443a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:04.055867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b9829-d3c1-4b49-9cfc-fff54ef443a6 None admin] PATH_INFO: `/v3/projects/6dba2216e82b4f5a94d4af84c2899412` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:04.057575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b9829-d3c1-4b49-9cfc-fff54ef443a6 None admin] RBAC: Authorizing `identity:get_project(project_id=6dba2216e82b4f5a94d4af84c2899412)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:04.059465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b9829-d3c1-4b49-9cfc-fff54ef443a6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:04.062369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 532/1070] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:03 2022] GET /identity/v3/projects/6dba2216e82b4f5a94d4af84c2899412 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:04.067795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b9829-d3c1-4b49-9cfc-fff54ef443a6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:04.085985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e325b-7852-4641-ad1d-5df3289c7a68 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:04.122065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd78d9-4521-452e-9493-ea443d0b19fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:04.122738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd78d9-4521-452e-9493-ea443d0b19fb None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:04.123012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd78d9-4521-452e-9493-ea443d0b19fb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:04.123288 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd78d9-4521-452e-9493-ea443d0b19fb None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/531ebc9dee0440888b94a6bf17d7a335/roles/64ab1a99959f496c9cca03b0df885dd6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:04.125512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd78d9-4521-452e-9493-ea443d0b19fb None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=531ebc9dee0440888b94a6bf17d7a335, role_id=64ab1a99959f496c9cca03b0df885dd6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:04.126922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd78d9-4521-452e-9493-ea443d0b19fb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:04.178933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b9829-d3c1-4b49-9cfc-fff54ef443a6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:04.211598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 539/1071] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:21:03 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/531ebc9dee0440888b94a6bf17d7a335/roles/64ab1a99959f496c9cca03b0df885dd6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:21:04.216007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42882d-b7e5-445f-a235-3f8b1cd21ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:04.216646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42882d-b7e5-445f-a235-3f8b1cd21ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:04.216927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42882d-b7e5-445f-a235-3f8b1cd21ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:04.217233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42882d-b7e5-445f-a235-3f8b1cd21ae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:04.218059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42882d-b7e5-445f-a235-3f8b1cd21ae0 None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=6dba2216e82b4f5a94d4af84c2899412, user.id=438563771286452a93fd5d7572592f7f) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:04.218376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42882d-b7e5-445f-a235-3f8b1cd21ae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:04.219860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42882d-b7e5-445f-a235-3f8b1cd21ae0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:04.237286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 533/1072] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:21:04 2022] GET /identity/v3/role_assignments?user.id=438563771286452a93fd5d7572592f7f&scope.project.id=6dba2216e82b4f5a94d4af84c2899412&role.id=57a86ff4c9de433399662eebf6893065 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:05.115045 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4670f-ea6d-48d7-979f-e5c9bde2a3e0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:05.115602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4670f-ea6d-48d7-979f-e5c9bde2a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:05.115602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4670f-ea6d-48d7-979f-e5c9bde2a3e0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:05.117920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 540/1073] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:05.123088 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ff89-f562-4314-9e4d-4db8182aa62d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:05.123378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ff89-f562-4314-9e4d-4db8182aa62d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:05.123651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ff89-f562-4314-9e4d-4db8182aa62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:05.141529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-99c9ff89-f562-4314-9e4d-4db8182aa62d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:05.142711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-99c9ff89-f562-4314-9e4d-4db8182aa62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:05.153166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:05.217172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 534/1074] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:05.237144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4670f-ea6d-48d7-979f-e5c9bde2a3e0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:05.319504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:05.346016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4670f-ea6d-48d7-979f-e5c9bde2a3e0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:05.382687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f9487-58b6-4c41-8993-34441028c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:05.383219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f9487-58b6-4c41-8993-34441028c343 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:05.383497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f9487-58b6-4c41-8993-34441028c343 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:05.383773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f9487-58b6-4c41-8993-34441028c343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:05.450623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f9487-58b6-4c41-8993-34441028c343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:05.452062 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f9487-58b6-4c41-8993-34441028c343 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:05.580234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:05.603118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 541/1075] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:21:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:21:05.608823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9ff89-f562-4314-9e4d-4db8182aa62d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:05.707325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9ff89-f562-4314-9e4d-4db8182aa62d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:05.742406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27baf-b79a-4658-a98d-14077bf7d585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:05.743041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27baf-b79a-4658-a98d-14077bf7d585 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:05.743315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27baf-b79a-4658-a98d-14077bf7d585 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:05.743577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27baf-b79a-4658-a98d-14077bf7d585 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:05.753572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27baf-b79a-4658-a98d-14077bf7d585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:05.755016 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27baf-b79a-4658-a98d-14077bf7d585 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:05.758049 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-70d27baf-b79a-4658-a98d-14077bf7d585 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:21:05.770595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:05.774429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:05.775350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:21:05.775350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:21:05.775350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:21:05.775350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:05.775350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 535/1076] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:05.778435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f9487-58b6-4c41-8993-34441028c343 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:05.878168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f9487-58b6-4c41-8993-34441028c343 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:05.911461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdda770-cef9-419b-b694-3ea2a189cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:05.912114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda770-cef9-419b-b694-3ea2a189cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:05.912346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda770-cef9-419b-b694-3ea2a189cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:05.913339 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda770-cef9-419b-b694-3ea2a189cfc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:05.914025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdda770-cef9-419b-b694-3ea2a189cfc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:05.914321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdda770-cef9-419b-b694-3ea2a189cfc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:05.915670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdda770-cef9-419b-b694-3ea2a189cfc0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:05.927617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 542/1077] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:06.240114 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b29e16-9a59-4075-a72f-b7df8b2e672d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:06.240679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b29e16-9a59-4075-a72f-b7df8b2e672d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:06.240808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b29e16-9a59-4075-a72f-b7df8b2e672d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:06.242393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 536/1078] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:06.247627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99aee-c5c1-4cc6-82da-d08a222d91f7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:06.248024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99aee-c5c1-4cc6-82da-d08a222d91f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:06.248169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c99aee-c5c1-4cc6-82da-d08a222d91f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:06.264936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33ef37-f1e9-468c-abfb-bc3558255e85 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:06.265251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33ef37-f1e9-468c-abfb-bc3558255e85 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:06.265524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33ef37-f1e9-468c-abfb-bc3558255e85 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:06.266600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-52c99aee-c5c1-4cc6-82da-d08a222d91f7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:06.266840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 537/1079] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:21:06.267791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-52c99aee-c5c1-4cc6-82da-d08a222d91f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:06.271575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ec982-f82e-4728-8235-7219a5fd16ba None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:06.272555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ec982-f82e-4728-8235-7219a5fd16ba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:06.273081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ec982-f82e-4728-8235-7219a5fd16ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:06.290211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-579ec982-f82e-4728-8235-7219a5fd16ba None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:06.291375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-579ec982-f82e-4728-8235-7219a5fd16ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:06.296591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:06.336713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 543/1080] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:06.357809 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 538/1081] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:21:06.358966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c99aee-c5c1-4cc6-82da-d08a222d91f7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:06.380346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ec982-f82e-4728-8235-7219a5fd16ba None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:06.455991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c99aee-c5c1-4cc6-82da-d08a222d91f7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:06.479431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ec982-f82e-4728-8235-7219a5fd16ba None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:06.489851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe12556-d9ca-47d7-9a8e-baa63c2ea3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:06.490528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe12556-d9ca-47d7-9a8e-baa63c2ea3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:06.490805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe12556-d9ca-47d7-9a8e-baa63c2ea3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:06.491245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe12556-d9ca-47d7-9a8e-baa63c2ea3a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:06.501212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe12556-d9ca-47d7-9a8e-baa63c2ea3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-bbe12556-d9ca-47d7-9a8e-baa63c2ea3a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:21:06.506626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:06.507754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:21:06.508822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 544/1082] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:21:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:21:06.513773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe12556-d9ca-47d7-9a8e-baa63c2ea3a1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:06.573704 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:06.574729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:06.583067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c84ff6-ca6d-4dd6-ac36-497e43de82c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:06.583710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84ff6-ca6d-4dd6-ac36-497e43de82c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:06.583987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84ff6-ca6d-4dd6-ac36-497e43de82c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:06.584931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84ff6-ca6d-4dd6-ac36-497e43de82c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:06.594986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c84ff6-ca6d-4dd6-ac36-497e43de82c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a0c84ff6-ca6d-4dd6-ac36-497e43de82c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:21:06.599943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:06.600915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:06.601908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 539/1083] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 05:21:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:21:06.607057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c84ff6-ca6d-4dd6-ac36-497e43de82c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:06.645872 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe12556-d9ca-47d7-9a8e-baa63c2ea3a1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:06.680762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af11fc-75aa-4a27-9987-02893ba5874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:06.681405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af11fc-75aa-4a27-9987-02893ba5874b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:06.681691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af11fc-75aa-4a27-9987-02893ba5874b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:06.681959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af11fc-75aa-4a27-9987-02893ba5874b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:06.682663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af11fc-75aa-4a27-9987-02893ba5874b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:06.682966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af11fc-75aa-4a27-9987-02893ba5874b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:06.684326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af11fc-75aa-4a27-9987-02893ba5874b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:06.692213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 545/1084] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:21:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:06.698982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af11fc-75aa-4a27-9987-02893ba5874b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:06.706689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c84ff6-ca6d-4dd6-ac36-497e43de82c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:06.741435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28af7b8-5eb5-4eea-a1a9-7da3af5e699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:06.742057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28af7b8-5eb5-4eea-a1a9-7da3af5e699d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:06.742338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28af7b8-5eb5-4eea-a1a9-7da3af5e699d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:06.742614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28af7b8-5eb5-4eea-a1a9-7da3af5e699d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:06.743331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28af7b8-5eb5-4eea-a1a9-7da3af5e699d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:06.743633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28af7b8-5eb5-4eea-a1a9-7da3af5e699d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:06.745007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28af7b8-5eb5-4eea-a1a9-7da3af5e699d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:06.752750 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 540/1085] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 05:21:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:06.759407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28af7b8-5eb5-4eea-a1a9-7da3af5e699d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:06.785796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:06.798417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af11fc-75aa-4a27-9987-02893ba5874b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:06.807983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:06.834205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8eb5c-7de7-49a6-9327-dc08cfac27f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:06.835167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8eb5c-7de7-49a6-9327-dc08cfac27f7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:06.835445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8eb5c-7de7-49a6-9327-dc08cfac27f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:06.835718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8eb5c-7de7-49a6-9327-dc08cfac27f7 None admin] PATH_INFO: `/v3/users/438563771286452a93fd5d7572592f7f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:06.836957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8eb5c-7de7-49a6-9327-dc08cfac27f7 None admin] RBAC: Authorizing `identity:get_user(user_id=438563771286452a93fd5d7572592f7f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:06.838409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8eb5c-7de7-49a6-9327-dc08cfac27f7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:06.839992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 546/1086] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:06 2022] GET /identity/v3/users/438563771286452a93fd5d7572592f7f => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:06.845621 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8eb5c-7de7-49a6-9327-dc08cfac27f7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:06.859128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28af7b8-5eb5-4eea-a1a9-7da3af5e699d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:06.892615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e33884-5ca2-49bb-b940-e767d837e069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:06.893379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e33884-5ca2-49bb-b940-e767d837e069 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:06.893530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e33884-5ca2-49bb-b940-e767d837e069 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:06.893803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e33884-5ca2-49bb-b940-e767d837e069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:06.904422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e33884-5ca2-49bb-b940-e767d837e069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:06.905876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e33884-5ca2-49bb-b940-e767d837e069 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-00e33884-5ca2-49bb-b940-e767d837e069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:21:06.919847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:06.920981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:06.922100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:21:06.922100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:21:06.922100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:21:06.922100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:06.922100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 541/1087] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:21:06.927008 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e33884-5ca2-49bb-b940-e767d837e069 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:06.946519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8eb5c-7de7-49a6-9327-dc08cfac27f7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:06.980816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ae3a7-568f-494e-83b8-e089ba6416b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:06.981419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ae3a7-568f-494e-83b8-e089ba6416b4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:06.981697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ae3a7-568f-494e-83b8-e089ba6416b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:06.981972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ae3a7-568f-494e-83b8-e089ba6416b4 None admin] PATH_INFO: `/v3/projects/6dba2216e82b4f5a94d4af84c2899412` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:06.983120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ae3a7-568f-494e-83b8-e089ba6416b4 None admin] RBAC: Authorizing `identity:get_project(project_id=6dba2216e82b4f5a94d4af84c2899412)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:06.984547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ae3a7-568f-494e-83b8-e089ba6416b4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:06.986360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 547/1088] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:06 2022] GET /identity/v3/projects/6dba2216e82b4f5a94d4af84c2899412 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:06.992720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ae3a7-568f-494e-83b8-e089ba6416b4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:07.016743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:07.026287 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:07.029058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e33884-5ca2-49bb-b940-e767d837e069 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:07.063302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ad1ca-f440-42fd-83f1-a60acfd643d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:07.063913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad1ca-f440-42fd-83f1-a60acfd643d0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:07.064186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad1ca-f440-42fd-83f1-a60acfd643d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:07.064450 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad1ca-f440-42fd-83f1-a60acfd643d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:07.065154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ad1ca-f440-42fd-83f1-a60acfd643d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:07.066141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ad1ca-f440-42fd-83f1-a60acfd643d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:07.066884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ad1ca-f440-42fd-83f1-a60acfd643d0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:07.078835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 542/1089] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:07.085381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ad1ca-f440-42fd-83f1-a60acfd643d0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:07.089894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ae3a7-568f-494e-83b8-e089ba6416b4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:07.124191 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d240253-047a-40e5-a35b-cd54072a49ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:07.124859 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d240253-047a-40e5-a35b-cd54072a49ea None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:07.125155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d240253-047a-40e5-a35b-cd54072a49ea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:07.125442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d240253-047a-40e5-a35b-cd54072a49ea None admin] PATH_INFO: `/v3/projects/6dba2216e82b4f5a94d4af84c2899412/users/438563771286452a93fd5d7572592f7f/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:07.127404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d240253-047a-40e5-a35b-cd54072a49ea None admin] RBAC: Authorizing `identity:create_grant(project_id=6dba2216e82b4f5a94d4af84c2899412, user_id=438563771286452a93fd5d7572592f7f, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:07.128835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d240253-047a-40e5-a35b-cd54072a49ea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:07.183940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ad1ca-f440-42fd-83f1-a60acfd643d0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:07.198589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 548/1090] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:21:06 2022] PUT /identity/v3/projects/6dba2216e82b4f5a94d4af84c2899412/users/438563771286452a93fd5d7572592f7f/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:21:07.219748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3616d0c-b4bb-4120-9a45-bc9993e4d6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:07.220415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616d0c-b4bb-4120-9a45-bc9993e4d6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:07.220725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616d0c-b4bb-4120-9a45-bc9993e4d6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:07.220963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616d0c-b4bb-4120-9a45-bc9993e4d6b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:07.230297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3616d0c-b4bb-4120-9a45-bc9993e4d6b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:07.231857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3616d0c-b4bb-4120-9a45-bc9993e4d6b7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b3616d0c-b4bb-4120-9a45-bc9993e4d6b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:21:07.245513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:07.247178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:07.248375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:07.248375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:07.248375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:21:07.248375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:21:07.248375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:21:07.248375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:21:07.248375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:21:07.248375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:21:07.248375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 05:21:07.248375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:07.248375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 543/1091] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 05:21:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:07.252857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d240253-047a-40e5-a35b-cd54072a49ea None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:07.342340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:07.358611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d240253-047a-40e5-a35b-cd54072a49ea None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:07.394571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46968e0d-8688-4b3f-9b92-6dc182b79aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:07.395193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46968e0d-8688-4b3f-9b92-6dc182b79aec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:07.395472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46968e0d-8688-4b3f-9b92-6dc182b79aec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:07.395743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46968e0d-8688-4b3f-9b92-6dc182b79aec None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:07.396530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46968e0d-8688-4b3f-9b92-6dc182b79aec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:07.397090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46968e0d-8688-4b3f-9b92-6dc182b79aec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:07.398720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46968e0d-8688-4b3f-9b92-6dc182b79aec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:07.416584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 549/1092] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 05:21:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:07.422308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3616d0c-b4bb-4120-9a45-bc9993e4d6b7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:07.445566 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:07.521869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3616d0c-b4bb-4120-9a45-bc9993e4d6b7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:07.555172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22671e-542a-4dfb-a63d-56dc070db40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:07.555786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22671e-542a-4dfb-a63d-56dc070db40a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:07.556064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22671e-542a-4dfb-a63d-56dc070db40a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:07.556333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22671e-542a-4dfb-a63d-56dc070db40a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:07.621835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22671e-542a-4dfb-a63d-56dc070db40a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:07.623285 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22671e-542a-4dfb-a63d-56dc070db40a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:07.643730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:07.720298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 544/1093] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:21:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:21:07.726669 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46968e0d-8688-4b3f-9b92-6dc182b79aec None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:07.823275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46968e0d-8688-4b3f-9b92-6dc182b79aec None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:07.858507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0ae0e-73a6-4cf8-b706-39e8d9a01ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:07.859143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ae0e-73a6-4cf8-b706-39e8d9a01ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:07.859419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ae0e-73a6-4cf8-b706-39e8d9a01ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:07.859690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ae0e-73a6-4cf8-b706-39e8d9a01ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:07.869541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0ae0e-73a6-4cf8-b706-39e8d9a01ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:07.870972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0ae0e-73a6-4cf8-b706-39e8d9a01ac4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:07.872610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-57f0ae0e-73a6-4cf8-b706-39e8d9a01ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:21:07.887367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:07.888485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:07.889462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:21:07.889462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:21:07.889462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:21:07.889462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:21:07.889462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 550/1094] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:21:07.894387 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22671e-542a-4dfb-a63d-56dc070db40a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:07.991740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22671e-542a-4dfb-a63d-56dc070db40a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:08.012012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:08.026443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1355511-9408-4846-9332-73ea799470f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:08.027050 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1355511-9408-4846-9332-73ea799470f3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:08.027328 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1355511-9408-4846-9332-73ea799470f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:08.027597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1355511-9408-4846-9332-73ea799470f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:08.028308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1355511-9408-4846-9332-73ea799470f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:08.028609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1355511-9408-4846-9332-73ea799470f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:08.030035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1355511-9408-4846-9332-73ea799470f3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:08.041706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 545/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:08.047398 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0ae0e-73a6-4cf8-b706-39e8d9a01ac4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:08.148642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0ae0e-73a6-4cf8-b706-39e8d9a01ac4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:08.184053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7a929-1ef3-434b-8f9e-4359a8fdfdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:08.184692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7a929-1ef3-434b-8f9e-4359a8fdfdaa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:08.184967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7a929-1ef3-434b-8f9e-4359a8fdfdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:08.185271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7a929-1ef3-434b-8f9e-4359a8fdfdaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:08.191703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7a929-1ef3-434b-8f9e-4359a8fdfdaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:08.193121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7a929-1ef3-434b-8f9e-4359a8fdfdaa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-aee7a929-1ef3-434b-8f9e-4359a8fdfdaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:21:08.204554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:08.205474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:08.206414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:21:08.206414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:21:08.206414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:21:08.206414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:21:08.206414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:21:08.206414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:21:08.206414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:21:08.206414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:21:08.206414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 551/1096] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:21:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:08.212317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1355511-9408-4846-9332-73ea799470f3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:08.310888 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1355511-9408-4846-9332-73ea799470f3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:08.346510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08570bc9-b663-428b-8e63-6601ef43d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:08.347128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08570bc9-b663-428b-8e63-6601ef43d4da None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:08.347404 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08570bc9-b663-428b-8e63-6601ef43d4da None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:08.347671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08570bc9-b663-428b-8e63-6601ef43d4da None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:08.348416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08570bc9-b663-428b-8e63-6601ef43d4da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:08.348720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08570bc9-b663-428b-8e63-6601ef43d4da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:08.351019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08570bc9-b663-428b-8e63-6601ef43d4da None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:08.362776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 546/1097] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:21:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:08.369224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7a929-1ef3-434b-8f9e-4359a8fdfdaa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:08.423887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:08.467053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7a929-1ef3-434b-8f9e-4359a8fdfdaa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:08.501694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82b9c3-9dbc-4e86-a9e5-900c14e804f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:08.502300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b9c3-9dbc-4e86-a9e5-900c14e804f2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:08.502579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b9c3-9dbc-4e86-a9e5-900c14e804f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:08.502851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b9c3-9dbc-4e86-a9e5-900c14e804f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:08.503707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82b9c3-9dbc-4e86-a9e5-900c14e804f2 None admin] RBAC: Adding query filter params (role.id=64ab1a99959f496c9cca03b0df885dd6, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=531ebc9dee0440888b94a6bf17d7a335) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:08.504014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82b9c3-9dbc-4e86-a9e5-900c14e804f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:08.505492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82b9c3-9dbc-4e86-a9e5-900c14e804f2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:08.511416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 552/1098] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:21:08 2022] GET /identity/v3/role_assignments?user.id=531ebc9dee0440888b94a6bf17d7a335&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=64ab1a99959f496c9cca03b0df885dd6 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:09.224099 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1af8a-3b98-4215-b583-5465a38769e5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:09.224382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1af8a-3b98-4215-b583-5465a38769e5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:09.225406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1af8a-3b98-4215-b583-5465a38769e5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:09.226742 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 547/1099] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:09.232279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc59479-f120-4e59-b10d-5e9bd35fb1fc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:09.232565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc59479-f120-4e59-b10d-5e9bd35fb1fc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:09.232840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc59479-f120-4e59-b10d-5e9bd35fb1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:09.251187 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ddc59479-f120-4e59-b10d-5e9bd35fb1fc None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:09.252490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ddc59479-f120-4e59-b10d-5e9bd35fb1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:09.321860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 553/1100] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:09.344517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1af8a-3b98-4215-b583-5465a38769e5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:09.387657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:09.443572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1af8a-3b98-4215-b583-5465a38769e5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:09.476280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8af18-87c6-4ead-b2c2-443ff38eac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:09.476948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8af18-87c6-4ead-b2c2-443ff38eac85 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:09.477252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8af18-87c6-4ead-b2c2-443ff38eac85 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:09.477526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8af18-87c6-4ead-b2c2-443ff38eac85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:09.487362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8af18-87c6-4ead-b2c2-443ff38eac85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-35d8af18-87c6-4ead-b2c2-443ff38eac85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:21:09.492815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:09.493984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:09.495026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 548/1101] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:21:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:09.500034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc59479-f120-4e59-b10d-5e9bd35fb1fc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:09.546690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:09.595865 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc59479-f120-4e59-b10d-5e9bd35fb1fc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:09.628608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18074dc4-8bfa-4381-9738-8aca746a0f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:09.629230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074dc4-8bfa-4381-9738-8aca746a0f11 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:09.629509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074dc4-8bfa-4381-9738-8aca746a0f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:09.629776 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074dc4-8bfa-4381-9738-8aca746a0f11 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:09.630468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18074dc4-8bfa-4381-9738-8aca746a0f11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:09.630764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18074dc4-8bfa-4381-9738-8aca746a0f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:09.632145 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18074dc4-8bfa-4381-9738-8aca746a0f11 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:09.639821 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 554/1102] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:21:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:09.645547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8af18-87c6-4ead-b2c2-443ff38eac85 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:09.740026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:09.742822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8af18-87c6-4ead-b2c2-443ff38eac85 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:09.774999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bbbc0-8603-4a67-bccf-18f39763db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:09.775611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bbbc0-8603-4a67-bccf-18f39763db07 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:09.775916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bbbc0-8603-4a67-bccf-18f39763db07 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:09.776185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bbbc0-8603-4a67-bccf-18f39763db07 None admin] PATH_INFO: `/v3/users/438563771286452a93fd5d7572592f7f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:09.777346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bbbc0-8603-4a67-bccf-18f39763db07 None admin] RBAC: Authorizing `identity:get_user(user_id=438563771286452a93fd5d7572592f7f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:09.778768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bbbc0-8603-4a67-bccf-18f39763db07 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:09.780319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 549/1103] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:09 2022] GET /identity/v3/users/438563771286452a93fd5d7572592f7f => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:09.785988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18074dc4-8bfa-4381-9738-8aca746a0f11 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:09.884190 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18074dc4-8bfa-4381-9738-8aca746a0f11 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:09.893945 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:09.916981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2462044-5754-4114-9377-09d6361b39c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:09.917615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2462044-5754-4114-9377-09d6361b39c7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:09.917895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2462044-5754-4114-9377-09d6361b39c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:09.918167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2462044-5754-4114-9377-09d6361b39c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:09.983144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2462044-5754-4114-9377-09d6361b39c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:09.984578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2462044-5754-4114-9377-09d6361b39c7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:10.078762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 555/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:21:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:21:10.084668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bbbc0-8603-4a67-bccf-18f39763db07 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:10.184424 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bbbc0-8603-4a67-bccf-18f39763db07 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:10.216842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075ff6b-76ea-49e1-8d83-ffdc456a46d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:10.217496 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ff6b-76ea-49e1-8d83-ffdc456a46d8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:10.217778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ff6b-76ea-49e1-8d83-ffdc456a46d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:10.218048 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ff6b-76ea-49e1-8d83-ffdc456a46d8 None admin] PATH_INFO: `/v3/projects/6dba2216e82b4f5a94d4af84c2899412` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:10.219186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075ff6b-76ea-49e1-8d83-ffdc456a46d8 None admin] RBAC: Authorizing `identity:get_project(project_id=6dba2216e82b4f5a94d4af84c2899412)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:10.220612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075ff6b-76ea-49e1-8d83-ffdc456a46d8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:10.222361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 550/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:10 2022] GET /identity/v3/projects/6dba2216e82b4f5a94d4af84c2899412 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:10.229094 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2462044-5754-4114-9377-09d6361b39c7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:10.240512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:10.325616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2462044-5754-4114-9377-09d6361b39c7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:10.359002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d8f39-e560-490f-894a-68c48728c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:10.359541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d8f39-e560-490f-894a-68c48728c5cc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:10.359822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d8f39-e560-490f-894a-68c48728c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:10.360096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d8f39-e560-490f-894a-68c48728c5cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:10.360878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d8f39-e560-490f-894a-68c48728c5cc None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=6dba2216e82b4f5a94d4af84c2899412, user.id=438563771286452a93fd5d7572592f7f) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:10.361214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d8f39-e560-490f-894a-68c48728c5cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:10.362632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d8f39-e560-490f-894a-68c48728c5cc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:10.368805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 556/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:21:10 2022] GET /identity/v3/role_assignments?user.id=438563771286452a93fd5d7572592f7f&scope.project.id=6dba2216e82b4f5a94d4af84c2899412&role.id=57a86ff4c9de433399662eebf6893065 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:12.391873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf76f5-0846-4eee-96d0-77f95f3c8500 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:12.392387 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf76f5-0846-4eee-96d0-77f95f3c8500 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:12.392480 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf76f5-0846-4eee-96d0-77f95f3c8500 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:12.393795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 551/1107] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:12.399213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced5091-ecde-4e59-a141-cea49d53cd59 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:12.399631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced5091-ecde-4e59-a141-cea49d53cd59 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:12.399767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced5091-ecde-4e59-a141-cea49d53cd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:12.418162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6ced5091-ecde-4e59-a141-cea49d53cd59 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:12.419288 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6ced5091-ecde-4e59-a141-cea49d53cd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:12.484757 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 557/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:12.509541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf76f5-0846-4eee-96d0-77f95f3c8500 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:12.544515 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:12.607747 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf76f5-0846-4eee-96d0-77f95f3c8500 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:12.641311 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad70da-425d-4859-999d-6c46d0c1b20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:12.641928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad70da-425d-4859-999d-6c46d0c1b20a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:12.642202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad70da-425d-4859-999d-6c46d0c1b20a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:12.642464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad70da-425d-4859-999d-6c46d0c1b20a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:12.643580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad70da-425d-4859-999d-6c46d0c1b20a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:12.644995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad70da-425d-4859-999d-6c46d0c1b20a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:12.647194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 552/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:21:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:12.653219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced5091-ecde-4e59-a141-cea49d53cd59 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:12.656216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:12.750385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced5091-ecde-4e59-a141-cea49d53cd59 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:12.783130 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4bdf6-8541-4d67-b6e3-5f840a752630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:12.783734 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4bdf6-8541-4d67-b6e3-5f840a752630 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:12.784013 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4bdf6-8541-4d67-b6e3-5f840a752630 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:12.784284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4bdf6-8541-4d67-b6e3-5f840a752630 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:12.784961 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4bdf6-8541-4d67-b6e3-5f840a752630 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:12.786401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4bdf6-8541-4d67-b6e3-5f840a752630 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:12.894227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 558/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:21:12 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:21:14.920411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e194d1-ff8b-428c-b84f-c01db8099ea9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:14.920942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e194d1-ff8b-428c-b84f-c01db8099ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:14.920942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e194d1-ff8b-428c-b84f-c01db8099ea9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:14.922339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 553/1111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:14.928275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351c0d-b405-438d-83e4-1c036e62fffd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:14.928829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351c0d-b405-438d-83e4-1c036e62fffd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:14.928829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3351c0d-b405-438d-83e4-1c036e62fffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:14.947327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a3351c0d-b405-438d-83e4-1c036e62fffd None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:14.948508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a3351c0d-b405-438d-83e4-1c036e62fffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:15.002867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:15.014400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 559/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:15.037749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e194d1-ff8b-428c-b84f-c01db8099ea9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:15.137087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e194d1-ff8b-428c-b84f-c01db8099ea9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:15.139350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:15.170263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf203419-6927-46db-ac38-c2cb53aa16b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:15.170946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf203419-6927-46db-ac38-c2cb53aa16b5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:15.171174 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf203419-6927-46db-ac38-c2cb53aa16b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:15.171443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf203419-6927-46db-ac38-c2cb53aa16b5 None admin] PATH_INFO: `/v3/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:15.172865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf203419-6927-46db-ac38-c2cb53aa16b5 None admin] RBAC: Authorizing `identity:get_role(role_id=e24e5dc3a48b4cfdac7a99de5f2f78a7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:15.174544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf203419-6927-46db-ac38-c2cb53aa16b5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:15.175886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 554/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:15 2022] GET /identity/v3/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:15.182229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3351c0d-b405-438d-83e4-1c036e62fffd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:15.276924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3351c0d-b405-438d-83e4-1c036e62fffd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:15.309937 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e159855-3e64-429a-b407-7c2e2ba0db78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:15.310555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159855-3e64-429a-b407-7c2e2ba0db78 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:15.310832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159855-3e64-429a-b407-7c2e2ba0db78 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:15.311098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159855-3e64-429a-b407-7c2e2ba0db78 None admin] PATH_INFO: `/v3/users/ce53048cee51484d98f23d41ebc159f0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:15.323604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e159855-3e64-429a-b407-7c2e2ba0db78 None admin] RBAC: Authorizing `identity:get_user(user_id=ce53048cee51484d98f23d41ebc159f0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:15.325030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e159855-3e64-429a-b407-7c2e2ba0db78 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:15.326627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 560/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:15 2022] GET /identity/v3/users/ce53048cee51484d98f23d41ebc159f0 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:15.332310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf203419-6927-46db-ac38-c2cb53aa16b5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:15.427089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf203419-6927-46db-ac38-c2cb53aa16b5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:15.459431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d664485-42cd-45b1-b609-3342af4ab104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:15.460023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664485-42cd-45b1-b609-3342af4ab104 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:15.460297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664485-42cd-45b1-b609-3342af4ab104 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:15.460564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664485-42cd-45b1-b609-3342af4ab104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:15.500025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:15.524930 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d664485-42cd-45b1-b609-3342af4ab104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:15.526388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d664485-42cd-45b1-b609-3342af4ab104 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:15.621407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 555/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:21:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:21:15.627464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e159855-3e64-429a-b407-7c2e2ba0db78 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:15.676566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:15.726655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e159855-3e64-429a-b407-7c2e2ba0db78 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:15.758762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72bfaa-b65f-47d7-a085-91807f8a270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:15.759392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72bfaa-b65f-47d7-a085-91807f8a270c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:15.759675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72bfaa-b65f-47d7-a085-91807f8a270c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:15.759947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72bfaa-b65f-47d7-a085-91807f8a270c None admin] PATH_INFO: `/v3/projects/6dba2216e82b4f5a94d4af84c2899412` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:15.761168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72bfaa-b65f-47d7-a085-91807f8a270c None admin] RBAC: Authorizing `identity:get_project(project_id=6dba2216e82b4f5a94d4af84c2899412)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:15.762600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72bfaa-b65f-47d7-a085-91807f8a270c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:15.764249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 561/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:15 2022] GET /identity/v3/projects/6dba2216e82b4f5a94d4af84c2899412 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:15.770501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d664485-42cd-45b1-b609-3342af4ab104 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:15.855200 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:15.882976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d664485-42cd-45b1-b609-3342af4ab104 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:15.916372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6a6b2-bf6c-4ad5-900e-559679d0ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:15.916967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6a6b2-bf6c-4ad5-900e-559679d0ae46 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:15.917271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6a6b2-bf6c-4ad5-900e-559679d0ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:15.917542 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6a6b2-bf6c-4ad5-900e-559679d0ae46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:15.918422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6a6b2-bf6c-4ad5-900e-559679d0ae46 None admin] RBAC: Adding query filter params (role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7, scope.project.id=6dba2216e82b4f5a94d4af84c2899412, user.id=ce53048cee51484d98f23d41ebc159f0) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:15.918738 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6a6b2-bf6c-4ad5-900e-559679d0ae46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:15.920198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6a6b2-bf6c-4ad5-900e-559679d0ae46 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:15.925723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 556/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:21:15 2022] GET /identity/v3/role_assignments?user.id=ce53048cee51484d98f23d41ebc159f0&scope.project.id=6dba2216e82b4f5a94d4af84c2899412&role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:17.896808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d87ec9-73ab-4dd6-9f55-142be92d1d8b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:17.897931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d87ec9-73ab-4dd6-9f55-142be92d1d8b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:17.897931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d87ec9-73ab-4dd6-9f55-142be92d1d8b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:17.899528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 562/1118] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:17.904604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27534a20-d5f1-4d0d-a99f-7cee3084f08c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:17.905042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27534a20-d5f1-4d0d-a99f-7cee3084f08c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:17.905189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27534a20-d5f1-4d0d-a99f-7cee3084f08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:17.924098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-27534a20-d5f1-4d0d-a99f-7cee3084f08c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:17.925305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-27534a20-d5f1-4d0d-a99f-7cee3084f08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:17.990741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 557/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:18.012698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d87ec9-73ab-4dd6-9f55-142be92d1d8b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:18.113164 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d87ec9-73ab-4dd6-9f55-142be92d1d8b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:18.129028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:18.146208 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700ca0c-2157-443b-85b0-90e7d43b984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:18.146892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700ca0c-2157-443b-85b0-90e7d43b984f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:18.147126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700ca0c-2157-443b-85b0-90e7d43b984f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:18.148070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700ca0c-2157-443b-85b0-90e7d43b984f None admin] PATH_INFO: `/v3/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:18.149648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700ca0c-2157-443b-85b0-90e7d43b984f None admin] RBAC: Authorizing `identity:get_role(role_id=e24e5dc3a48b4cfdac7a99de5f2f78a7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:18.151021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700ca0c-2157-443b-85b0-90e7d43b984f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:18.152347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 563/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:18 2022] GET /identity/v3/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:18.158443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27534a20-d5f1-4d0d-a99f-7cee3084f08c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:18.221864 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:18.254086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27534a20-d5f1-4d0d-a99f-7cee3084f08c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:18.288472 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee5557-55c7-430f-9177-0b3868dbb051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:18.288821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee5557-55c7-430f-9177-0b3868dbb051 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:18.289102 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee5557-55c7-430f-9177-0b3868dbb051 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:18.289408 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee5557-55c7-430f-9177-0b3868dbb051 None admin] PATH_INFO: `/v3/users/ce53048cee51484d98f23d41ebc159f0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:18.290565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee5557-55c7-430f-9177-0b3868dbb051 None admin] RBAC: Authorizing `identity:get_user(user_id=ce53048cee51484d98f23d41ebc159f0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:18.292004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee5557-55c7-430f-9177-0b3868dbb051 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:18.293629 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 558/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:18 2022] GET /identity/v3/users/ce53048cee51484d98f23d41ebc159f0 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:18.299709 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700ca0c-2157-443b-85b0-90e7d43b984f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:18.396868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700ca0c-2157-443b-85b0-90e7d43b984f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:18.431107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f02440-911e-49e4-b715-709abfa6d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:18.431667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f02440-911e-49e4-b715-709abfa6d983 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:18.431940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f02440-911e-49e4-b715-709abfa6d983 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:18.432206 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f02440-911e-49e4-b715-709abfa6d983 None admin] PATH_INFO: `/v3/projects/6dba2216e82b4f5a94d4af84c2899412` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:18.433368 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f02440-911e-49e4-b715-709abfa6d983 None admin] RBAC: Authorizing `identity:get_project(project_id=6dba2216e82b4f5a94d4af84c2899412)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:18.434778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f02440-911e-49e4-b715-709abfa6d983 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:18.436381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 564/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:18 2022] GET /identity/v3/projects/6dba2216e82b4f5a94d4af84c2899412 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:18.442315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee5557-55c7-430f-9177-0b3868dbb051 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:18.540522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee5557-55c7-430f-9177-0b3868dbb051 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:18.573809 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d94a9-6a3b-4aba-8e01-3bc75ea03919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:18.574456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d94a9-6a3b-4aba-8e01-3bc75ea03919 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:18.574737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d94a9-6a3b-4aba-8e01-3bc75ea03919 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:18.575012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d94a9-6a3b-4aba-8e01-3bc75ea03919 None admin] PATH_INFO: `/v3/projects/6dba2216e82b4f5a94d4af84c2899412/users/ce53048cee51484d98f23d41ebc159f0/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:18.577201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d94a9-6a3b-4aba-8e01-3bc75ea03919 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dba2216e82b4f5a94d4af84c2899412, user_id=ce53048cee51484d98f23d41ebc159f0, role_id=e24e5dc3a48b4cfdac7a99de5f2f78a7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:18.578628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d94a9-6a3b-4aba-8e01-3bc75ea03919 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:18.580769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:18.642493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 559/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:21:18 2022] PUT /identity/v3/projects/6dba2216e82b4f5a94d4af84c2899412/users/ce53048cee51484d98f23d41ebc159f0/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:21:20.615734 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52808c-6d56-4fca-8a49-47b261892bbf None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:20.616287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52808c-6d56-4fca-8a49-47b261892bbf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:20.616451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52808c-6d56-4fca-8a49-47b261892bbf None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:20.618213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 565/1124] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:20.623271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2202-4021-4ca0-b925-b3720a634360 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:20.623649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2202-4021-4ca0-b925-b3720a634360 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:20.623826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2202-4021-4ca0-b925-b3720a634360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:20.641420 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f6bf2202-4021-4ca0-b925-b3720a634360 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:20.642598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f6bf2202-4021-4ca0-b925-b3720a634360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:20.706729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 560/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:20.730518 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52808c-6d56-4fca-8a49-47b261892bbf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:20.783041 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:20.830671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52808c-6d56-4fca-8a49-47b261892bbf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:20.864181 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81113c-6b90-4d7c-bae9-9de44a37570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:20.864809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81113c-6b90-4d7c-bae9-9de44a37570f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:20.865089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81113c-6b90-4d7c-bae9-9de44a37570f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:20.865392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81113c-6b90-4d7c-bae9-9de44a37570f None admin] PATH_INFO: `/v3/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:20.867075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81113c-6b90-4d7c-bae9-9de44a37570f None admin] RBAC: Authorizing `identity:get_role(role_id=e24e5dc3a48b4cfdac7a99de5f2f78a7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:20.868392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81113c-6b90-4d7c-bae9-9de44a37570f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:20.869754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 566/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:20 2022] GET /identity/v3/roles/e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:20.875669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf2202-4021-4ca0-b925-b3720a634360 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:20.971907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf2202-4021-4ca0-b925-b3720a634360 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:20.994686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:21.004861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032e5de-6eb6-4e1f-98f6-2199529b1f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:21.005579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e5de-6eb6-4e1f-98f6-2199529b1f4b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:21.007733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e5de-6eb6-4e1f-98f6-2199529b1f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:21.007733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e5de-6eb6-4e1f-98f6-2199529b1f4b None admin] PATH_INFO: `/v3/users/ce53048cee51484d98f23d41ebc159f0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:21.007733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032e5de-6eb6-4e1f-98f6-2199529b1f4b None admin] RBAC: Authorizing `identity:get_user(user_id=ce53048cee51484d98f23d41ebc159f0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:21.008806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032e5de-6eb6-4e1f-98f6-2199529b1f4b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:21.010416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 561/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:20 2022] GET /identity/v3/users/ce53048cee51484d98f23d41ebc159f0 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:21.016061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81113c-6b90-4d7c-bae9-9de44a37570f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:21.113809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81113c-6b90-4d7c-bae9-9de44a37570f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:21.132530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:21.145694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415dcea-6c2a-477a-b7f9-9f9c6d6454f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:21.146691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415dcea-6c2a-477a-b7f9-9f9c6d6454f1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:21.146691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415dcea-6c2a-477a-b7f9-9f9c6d6454f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:21.146884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415dcea-6c2a-477a-b7f9-9f9c6d6454f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:21.214246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415dcea-6c2a-477a-b7f9-9f9c6d6454f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:21.215708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415dcea-6c2a-477a-b7f9-9f9c6d6454f1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:21.309238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 567/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:21:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:21:21.315110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032e5de-6eb6-4e1f-98f6-2199529b1f4b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:21.412238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032e5de-6eb6-4e1f-98f6-2199529b1f4b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:21.445300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c300e4c-96eb-4f2d-978a-4b8bdcdde9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:21.445989 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300e4c-96eb-4f2d-978a-4b8bdcdde9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:21.446269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300e4c-96eb-4f2d-978a-4b8bdcdde9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:21.446539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300e4c-96eb-4f2d-978a-4b8bdcdde9b4 None admin] PATH_INFO: `/v3/projects/6dba2216e82b4f5a94d4af84c2899412` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:21.447732 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c300e4c-96eb-4f2d-978a-4b8bdcdde9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=6dba2216e82b4f5a94d4af84c2899412)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:21.449185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c300e4c-96eb-4f2d-978a-4b8bdcdde9b4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:21.450827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 562/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:21 2022] GET /identity/v3/projects/6dba2216e82b4f5a94d4af84c2899412 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:21.456927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415dcea-6c2a-477a-b7f9-9f9c6d6454f1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:21.478148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:21.554416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415dcea-6c2a-477a-b7f9-9f9c6d6454f1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:21.587932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42669af-b384-4d66-a043-36c95dca8506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:21.588535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42669af-b384-4d66-a043-36c95dca8506 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:21.588816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42669af-b384-4d66-a043-36c95dca8506 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:21.589090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42669af-b384-4d66-a043-36c95dca8506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:21.589896 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42669af-b384-4d66-a043-36c95dca8506 None admin] RBAC: Adding query filter params (role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7, scope.project.id=6dba2216e82b4f5a94d4af84c2899412, user.id=ce53048cee51484d98f23d41ebc159f0) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:21.590204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42669af-b384-4d66-a043-36c95dca8506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:21.591620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42669af-b384-4d66-a043-36c95dca8506 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:21.597264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 568/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:21:21 2022] GET /identity/v3/role_assignments?user.id=ce53048cee51484d98f23d41ebc159f0&scope.project.id=6dba2216e82b4f5a94d4af84c2899412&role.id=e24e5dc3a48b4cfdac7a99de5f2f78a7 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:23.602163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59f12b-d763-434d-903e-1fa860268065 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:23.602704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59f12b-d763-434d-903e-1fa860268065 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:23.602704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59f12b-d763-434d-903e-1fa860268065 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:23.604057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 563/1131] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:23.609250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c0d8b-a40b-4580-ac81-34bfc31f5c68 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:23.609656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c0d8b-a40b-4580-ac81-34bfc31f5c68 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:23.609808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c0d8b-a40b-4580-ac81-34bfc31f5c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:23.627403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2f8c0d8b-a40b-4580-ac81-34bfc31f5c68 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:23.628611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2f8c0d8b-a40b-4580-ac81-34bfc31f5c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:23.694540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 569/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:23.718191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59f12b-d763-434d-903e-1fa860268065 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:23.777550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:23.816520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59f12b-d763-434d-903e-1fa860268065 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:23.849489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f014c6d-948b-412e-9009-bfcf55224e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:23.850173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014c6d-948b-412e-9009-bfcf55224e6a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:23.850455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014c6d-948b-412e-9009-bfcf55224e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:23.850724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014c6d-948b-412e-9009-bfcf55224e6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:23.851879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f014c6d-948b-412e-9009-bfcf55224e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:23.853386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f014c6d-948b-412e-9009-bfcf55224e6a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:23.854898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 564/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:21:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:23.860701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c0d8b-a40b-4580-ac81-34bfc31f5c68 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:23.875991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:23.958685 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c0d8b-a40b-4580-ac81-34bfc31f5c68 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:23.992763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe275ad-3fab-4cbe-8753-b4947f5759ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:23.993389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe275ad-3fab-4cbe-8753-b4947f5759ce None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:23.993667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe275ad-3fab-4cbe-8753-b4947f5759ce None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:23.993934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe275ad-3fab-4cbe-8753-b4947f5759ce None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:23.994594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe275ad-3fab-4cbe-8753-b4947f5759ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:23.996001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe275ad-3fab-4cbe-8753-b4947f5759ce None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:24.077415 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 570/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:21:23 2022] POST /identity/v3/projects => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:21:26.103004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde98ea-7bd9-482b-b0d0-4aedcf9c4da6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:26.103531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde98ea-7bd9-482b-b0d0-4aedcf9c4da6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:26.103531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde98ea-7bd9-482b-b0d0-4aedcf9c4da6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:26.104904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 565/1135] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:26.110106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617780ab-910c-42d0-aa4e-1d95cac26354 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:26.110546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617780ab-910c-42d0-aa4e-1d95cac26354 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:26.110647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617780ab-910c-42d0-aa4e-1d95cac26354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:26.129671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-617780ab-910c-42d0-aa4e-1d95cac26354 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:26.130844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-617780ab-910c-42d0-aa4e-1d95cac26354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:26.190552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:26.198288 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 571/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:26.222187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde98ea-7bd9-482b-b0d0-4aedcf9c4da6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:26.322452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde98ea-7bd9-482b-b0d0-4aedcf9c4da6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:26.347808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:26.360203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba531f-27ec-43fb-b019-450b7f629ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:26.360203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba531f-27ec-43fb-b019-450b7f629ceb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:26.360203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba531f-27ec-43fb-b019-450b7f629ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:26.360203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba531f-27ec-43fb-b019-450b7f629ceb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:26.360592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba531f-27ec-43fb-b019-450b7f629ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:26.360592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba531f-27ec-43fb-b019-450b7f629ceb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:26.360915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 566/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:21:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:26.367122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617780ab-910c-42d0-aa4e-1d95cac26354 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:26.461681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617780ab-910c-42d0-aa4e-1d95cac26354 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:26.496456 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fa4d6-c0dc-485e-a09c-83743878820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:26.497070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fa4d6-c0dc-485e-a09c-83743878820d None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:26.497556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fa4d6-c0dc-485e-a09c-83743878820d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:26.497836 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fa4d6-c0dc-485e-a09c-83743878820d None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:26.498525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fa4d6-c0dc-485e-a09c-83743878820d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:26.499953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fa4d6-c0dc-485e-a09c-83743878820d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:26.579400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 572/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:21:26 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:21:28.618937 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c932-76ec-450a-9aaf-e772cfe266b7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:28.619459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c932-76ec-450a-9aaf-e772cfe266b7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:28.619554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2c932-76ec-450a-9aaf-e772cfe266b7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:28.620841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 567/1139] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:28.626107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843936e3-1bca-4026-85fb-e91700828bd4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:28.626527 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843936e3-1bca-4026-85fb-e91700828bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:28.626664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843936e3-1bca-4026-85fb-e91700828bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:28.644255 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-843936e3-1bca-4026-85fb-e91700828bd4 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:28.645468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-843936e3-1bca-4026-85fb-e91700828bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:28.691379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:28.710923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 573/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:28.733414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2c932-76ec-450a-9aaf-e772cfe266b7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:28.832318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2c932-76ec-450a-9aaf-e772cfe266b7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:28.865270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe396326-91ee-402f-820c-fc13eb7cceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:28.865945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396326-91ee-402f-820c-fc13eb7cceea None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:28.866202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396326-91ee-402f-820c-fc13eb7cceea None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:28.866474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396326-91ee-402f-820c-fc13eb7cceea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:28.876267 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe396326-91ee-402f-820c-fc13eb7cceea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fe396326-91ee-402f-820c-fc13eb7cceea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:21:28.881607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:28.883326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:28.884390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 568/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:21:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:28.888752 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843936e3-1bca-4026-85fb-e91700828bd4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:28.984851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843936e3-1bca-4026-85fb-e91700828bd4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:29.017624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc7894-32a8-4651-b080-549bdffffdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:29.018228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc7894-32a8-4651-b080-549bdffffdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:29.018508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc7894-32a8-4651-b080-549bdffffdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:29.018778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc7894-32a8-4651-b080-549bdffffdf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:29.019478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc7894-32a8-4651-b080-549bdffffdf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:29.019777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc7894-32a8-4651-b080-549bdffffdf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:29.021150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc7894-32a8-4651-b080-549bdffffdf4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:29.029095 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 574/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:21:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:29.034865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe396326-91ee-402f-820c-fc13eb7cceea None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:29.091291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:29.132638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe396326-91ee-402f-820c-fc13eb7cceea None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:29.166902 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529968ab-de11-488c-a770-8cb0a51f87d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:29.167841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529968ab-de11-488c-a770-8cb0a51f87d8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:29.167841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529968ab-de11-488c-a770-8cb0a51f87d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:29.168067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529968ab-de11-488c-a770-8cb0a51f87d8 None admin] PATH_INFO: `/v3/users/aabd939fae994ab889e05ef61c620b91` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:29.181290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529968ab-de11-488c-a770-8cb0a51f87d8 None admin] RBAC: Authorizing `identity:get_user(user_id=aabd939fae994ab889e05ef61c620b91)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:29.182745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529968ab-de11-488c-a770-8cb0a51f87d8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:29.184352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 569/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:29 2022] GET /identity/v3/users/aabd939fae994ab889e05ef61c620b91 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:29.190189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc7894-32a8-4651-b080-549bdffffdf4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:29.236274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:29.288716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc7894-32a8-4651-b080-549bdffffdf4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:29.320991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d0a3b-06a2-4f23-b45d-0dc0ca93b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:29.321636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0a3b-06a2-4f23-b45d-0dc0ca93b048 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:29.321920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0a3b-06a2-4f23-b45d-0dc0ca93b048 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:29.322197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0a3b-06a2-4f23-b45d-0dc0ca93b048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:29.387074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d0a3b-06a2-4f23-b45d-0dc0ca93b048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:29.388434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d0a3b-06a2-4f23-b45d-0dc0ca93b048 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:29.431934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:29.484643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 575/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:21:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 05:21:29.490649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529968ab-de11-488c-a770-8cb0a51f87d8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:29.587738 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529968ab-de11-488c-a770-8cb0a51f87d8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:29.601476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:29.620704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbc1fd-fcb6-409e-9249-8e11d4fa74a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:29.621363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbc1fd-fcb6-409e-9249-8e11d4fa74a1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:29.621678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbc1fd-fcb6-409e-9249-8e11d4fa74a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:29.621950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbc1fd-fcb6-409e-9249-8e11d4fa74a1 None admin] PATH_INFO: `/v3/projects/0c70a8cb289e4cd79f9f26d1fea125a1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:29.623102 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbc1fd-fcb6-409e-9249-8e11d4fa74a1 None admin] RBAC: Authorizing `identity:get_project(project_id=0c70a8cb289e4cd79f9f26d1fea125a1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:29.624591 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbc1fd-fcb6-409e-9249-8e11d4fa74a1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:29.626282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 570/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:29 2022] GET /identity/v3/projects/0c70a8cb289e4cd79f9f26d1fea125a1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:29.632975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d0a3b-06a2-4f23-b45d-0dc0ca93b048 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:29.728092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d0a3b-06a2-4f23-b45d-0dc0ca93b048 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:29.760195 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fd11c-18df-41e1-a4da-dc90250a3c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:29.760789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd11c-18df-41e1-a4da-dc90250a3c55 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:29.761063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd11c-18df-41e1-a4da-dc90250a3c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:29.761360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd11c-18df-41e1-a4da-dc90250a3c55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:29.762128 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fd11c-18df-41e1-a4da-dc90250a3c55 None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=0c70a8cb289e4cd79f9f26d1fea125a1, user.id=aabd939fae994ab889e05ef61c620b91) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:29.762431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fd11c-18df-41e1-a4da-dc90250a3c55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:29.763830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fd11c-18df-41e1-a4da-dc90250a3c55 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:29.768932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 576/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:21:29 2022] GET /identity/v3/role_assignments?user.id=aabd939fae994ab889e05ef61c620b91&scope.project.id=0c70a8cb289e4cd79f9f26d1fea125a1&role.id=57a86ff4c9de433399662eebf6893065 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:31.717531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afc021-1982-42e3-ad07-2b8304fb06d1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:31.718087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afc021-1982-42e3-ad07-2b8304fb06d1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:31.718087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afc021-1982-42e3-ad07-2b8304fb06d1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:31.719475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 571/1147] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:31.725445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b7a87-6008-4a95-8073-5996e571e518 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:31.725868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b7a87-6008-4a95-8073-5996e571e518 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:31.725981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b7a87-6008-4a95-8073-5996e571e518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:31.744119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-291b7a87-6008-4a95-8073-5996e571e518 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:31.745322 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-291b7a87-6008-4a95-8073-5996e571e518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:31.747205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:31.809979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 577/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:31.832088 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afc021-1982-42e3-ad07-2b8304fb06d1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:31.930734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afc021-1982-42e3-ad07-2b8304fb06d1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:31.962735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cc5c0-6aa6-4949-84d1-53a0eafcd30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:31.963367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cc5c0-6aa6-4949-84d1-53a0eafcd30b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:31.963641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cc5c0-6aa6-4949-84d1-53a0eafcd30b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:31.963910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cc5c0-6aa6-4949-84d1-53a0eafcd30b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:31.973876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cc5c0-6aa6-4949-84d1-53a0eafcd30b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9b5cc5c0-6aa6-4949-84d1-53a0eafcd30b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:21:31.979524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:31.980642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:31.981632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 572/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:21:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:31.986642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b7a87-6008-4a95-8073-5996e571e518 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:32.081669 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b7a87-6008-4a95-8073-5996e571e518 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:32.115024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6b301-4c96-470b-aeb1-7464d2d85063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:32.115741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6b301-4c96-470b-aeb1-7464d2d85063 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:32.116019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6b301-4c96-470b-aeb1-7464d2d85063 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:32.116290 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6b301-4c96-470b-aeb1-7464d2d85063 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:32.116995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6b301-4c96-470b-aeb1-7464d2d85063 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:32.117328 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6b301-4c96-470b-aeb1-7464d2d85063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:32.118682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6b301-4c96-470b-aeb1-7464d2d85063 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:32.123503 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:32.126684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 578/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:21:32.133165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cc5c0-6aa6-4949-84d1-53a0eafcd30b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:32.178019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:32.234680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cc5c0-6aa6-4949-84d1-53a0eafcd30b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:32.266414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103d1e9-a3ae-4d4a-a6cb-d94adf972b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:32.267042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103d1e9-a3ae-4d4a-a6cb-d94adf972b4b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:32.267321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103d1e9-a3ae-4d4a-a6cb-d94adf972b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:32.267591 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103d1e9-a3ae-4d4a-a6cb-d94adf972b4b None admin] PATH_INFO: `/v3/users/aabd939fae994ab889e05ef61c620b91` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:32.268722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103d1e9-a3ae-4d4a-a6cb-d94adf972b4b None admin] RBAC: Authorizing `identity:get_user(user_id=aabd939fae994ab889e05ef61c620b91)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:32.270252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103d1e9-a3ae-4d4a-a6cb-d94adf972b4b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:32.272384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 573/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:32 2022] GET /identity/v3/users/aabd939fae994ab889e05ef61c620b91 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:32.278262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6b301-4c96-470b-aeb1-7464d2d85063 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:32.375188 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6b301-4c96-470b-aeb1-7464d2d85063 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:32.407392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5ad2d-dd3d-4907-867e-1de6e058b2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:32.408015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5ad2d-dd3d-4907-867e-1de6e058b2aa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:32.408294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5ad2d-dd3d-4907-867e-1de6e058b2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:32.408562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5ad2d-dd3d-4907-867e-1de6e058b2aa None admin] PATH_INFO: `/v3/projects/0c70a8cb289e4cd79f9f26d1fea125a1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:32.409715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5ad2d-dd3d-4907-867e-1de6e058b2aa None admin] RBAC: Authorizing `identity:get_project(project_id=0c70a8cb289e4cd79f9f26d1fea125a1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:32.411129 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5ad2d-dd3d-4907-867e-1de6e058b2aa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:32.412862 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 579/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:32 2022] GET /identity/v3/projects/0c70a8cb289e4cd79f9f26d1fea125a1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:32.418849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103d1e9-a3ae-4d4a-a6cb-d94adf972b4b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:32.514940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103d1e9-a3ae-4d4a-a6cb-d94adf972b4b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:32.524606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:32.547025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee537a-4a2a-4862-90ed-ae58d58c6ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:32.547924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee537a-4a2a-4862-90ed-ae58d58c6ec5 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:32.548198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee537a-4a2a-4862-90ed-ae58d58c6ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:32.548467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee537a-4a2a-4862-90ed-ae58d58c6ec5 None admin] PATH_INFO: `/v3/projects/0c70a8cb289e4cd79f9f26d1fea125a1/users/aabd939fae994ab889e05ef61c620b91/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:32.550374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee537a-4a2a-4862-90ed-ae58d58c6ec5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c70a8cb289e4cd79f9f26d1fea125a1, user_id=aabd939fae994ab889e05ef61c620b91, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:32.551790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee537a-4a2a-4862-90ed-ae58d58c6ec5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:32.619848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 574/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:21:32 2022] PUT /identity/v3/projects/0c70a8cb289e4cd79f9f26d1fea125a1/users/aabd939fae994ab889e05ef61c620b91/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:21:34.565084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92efeb-0877-4a43-968d-52a01b828fd5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:34.565622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92efeb-0877-4a43-968d-52a01b828fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:34.565711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92efeb-0877-4a43-968d-52a01b828fd5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:34.566983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 580/1154] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:34.572361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb5d91-df5a-4f8d-82b9-1710520e45e6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:34.572754 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb5d91-df5a-4f8d-82b9-1710520e45e6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:34.572907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb5d91-df5a-4f8d-82b9-1710520e45e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:34.591266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e8cb5d91-df5a-4f8d-82b9-1710520e45e6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:34.592438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e8cb5d91-df5a-4f8d-82b9-1710520e45e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:34.656439 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 575/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:34.680346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92efeb-0877-4a43-968d-52a01b828fd5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:34.746214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:34.779561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92efeb-0877-4a43-968d-52a01b828fd5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:34.811648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5296-8e54-4f43-ac59-c3f0b4dd7d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:34.812272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5296-8e54-4f43-ac59-c3f0b4dd7d70 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:34.812548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5296-8e54-4f43-ac59-c3f0b4dd7d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:34.812819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5296-8e54-4f43-ac59-c3f0b4dd7d70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:34.824281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f5296-8e54-4f43-ac59-c3f0b4dd7d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3f4f5296-8e54-4f43-ac59-c3f0b4dd7d70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:21:34.828992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:34.830152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:21:34.831448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 581/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:21:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:34.836346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb5d91-df5a-4f8d-82b9-1710520e45e6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:34.931021 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:34.933863 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb5d91-df5a-4f8d-82b9-1710520e45e6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:34.965572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3816f6-40f2-46d0-97f9-340567edf365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:34.966176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3816f6-40f2-46d0-97f9-340567edf365 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:34.966459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3816f6-40f2-46d0-97f9-340567edf365 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:34.966928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3816f6-40f2-46d0-97f9-340567edf365 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:34.967862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3816f6-40f2-46d0-97f9-340567edf365 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:34.968190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3816f6-40f2-46d0-97f9-340567edf365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:34.970153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3816f6-40f2-46d0-97f9-340567edf365 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:34.978659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 576/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:21:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:34.984360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5296-8e54-4f43-ac59-c3f0b4dd7d70 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:35.080579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5296-8e54-4f43-ac59-c3f0b4dd7d70 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:35.105925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:35.113241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4df843-c53b-45b8-94dd-ea2080a69db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:35.113864 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4df843-c53b-45b8-94dd-ea2080a69db1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:35.114139 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4df843-c53b-45b8-94dd-ea2080a69db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:35.120482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4df843-c53b-45b8-94dd-ea2080a69db1 None admin] PATH_INFO: `/v3/users/aabd939fae994ab889e05ef61c620b91` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:35.120482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4df843-c53b-45b8-94dd-ea2080a69db1 None admin] RBAC: Authorizing `identity:get_user(user_id=aabd939fae994ab889e05ef61c620b91)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:35.120482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4df843-c53b-45b8-94dd-ea2080a69db1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:35.120482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 582/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:34 2022] GET /identity/v3/users/aabd939fae994ab889e05ef61c620b91 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:35.124293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3816f6-40f2-46d0-97f9-340567edf365 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:35.222546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3816f6-40f2-46d0-97f9-340567edf365 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:35.254795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35547959-91a2-4f99-ae04-2f3476ef208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:35.255403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547959-91a2-4f99-ae04-2f3476ef208c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:35.255683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547959-91a2-4f99-ae04-2f3476ef208c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:35.255953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35547959-91a2-4f99-ae04-2f3476ef208c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:35.284375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:35.320178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35547959-91a2-4f99-ae04-2f3476ef208c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:35.321653 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35547959-91a2-4f99-ae04-2f3476ef208c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:35.417514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 577/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:21:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:21:35.423616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4df843-c53b-45b8-94dd-ea2080a69db1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:35.523100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4df843-c53b-45b8-94dd-ea2080a69db1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:35.555021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b233431-63e2-4cf2-8c6a-3c81bb576147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:35.555653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b233431-63e2-4cf2-8c6a-3c81bb576147 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:35.555937 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b233431-63e2-4cf2-8c6a-3c81bb576147 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:35.556210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b233431-63e2-4cf2-8c6a-3c81bb576147 None admin] PATH_INFO: `/v3/projects/0c70a8cb289e4cd79f9f26d1fea125a1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:35.557379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b233431-63e2-4cf2-8c6a-3c81bb576147 None admin] RBAC: Authorizing `identity:get_project(project_id=0c70a8cb289e4cd79f9f26d1fea125a1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:35.558807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b233431-63e2-4cf2-8c6a-3c81bb576147 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:35.560435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 583/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:35 2022] GET /identity/v3/projects/0c70a8cb289e4cd79f9f26d1fea125a1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:35.566610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35547959-91a2-4f99-ae04-2f3476ef208c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:35.624887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:35.663140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35547959-91a2-4f99-ae04-2f3476ef208c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:35.695960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadafc9-54c6-4404-bc61-d6b10e04171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:35.696502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadafc9-54c6-4404-bc61-d6b10e04171c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:35.696780 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadafc9-54c6-4404-bc61-d6b10e04171c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:35.697051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadafc9-54c6-4404-bc61-d6b10e04171c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:35.697857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadafc9-54c6-4404-bc61-d6b10e04171c None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=0c70a8cb289e4cd79f9f26d1fea125a1, user.id=aabd939fae994ab889e05ef61c620b91) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:35.698171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadafc9-54c6-4404-bc61-d6b10e04171c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:35.699595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadafc9-54c6-4404-bc61-d6b10e04171c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:35.705145 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 578/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:21:35 2022] GET /identity/v3/role_assignments?user.id=aabd939fae994ab889e05ef61c620b91&scope.project.id=0c70a8cb289e4cd79f9f26d1fea125a1&role.id=57a86ff4c9de433399662eebf6893065 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:37.728347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed300a44-a3ce-4437-8e05-d80d1b69d32c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:37.728914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed300a44-a3ce-4437-8e05-d80d1b69d32c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:37.728914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed300a44-a3ce-4437-8e05-d80d1b69d32c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:37.730397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 584/1162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:37.735616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25666e-97fd-4cb6-a076-aaf54d1a08f1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:37.736013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25666e-97fd-4cb6-a076-aaf54d1a08f1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:37.736165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25666e-97fd-4cb6-a076-aaf54d1a08f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:37.754604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7b25666e-97fd-4cb6-a076-aaf54d1a08f1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:37.755967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7b25666e-97fd-4cb6-a076-aaf54d1a08f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:37.820221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 579/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:37.842064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed300a44-a3ce-4437-8e05-d80d1b69d32c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:37.903887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:37.942017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed300a44-a3ce-4437-8e05-d80d1b69d32c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:37.973696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878bfbb-6b53-4d20-b5f0-4382d602f3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:37.974834 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878bfbb-6b53-4d20-b5f0-4382d602f3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:37.975109 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878bfbb-6b53-4d20-b5f0-4382d602f3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:37.975378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878bfbb-6b53-4d20-b5f0-4382d602f3b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:38.039821 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878bfbb-6b53-4d20-b5f0-4382d602f3b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:38.041206 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878bfbb-6b53-4d20-b5f0-4382d602f3b8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:38.100229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:38.136935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 585/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:21:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:21:38.143231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25666e-97fd-4cb6-a076-aaf54d1a08f1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:38.198580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:38.242217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25666e-97fd-4cb6-a076-aaf54d1a08f1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:38.275332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbe37f-cd21-439e-9278-0efaa11451ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:38.275958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbe37f-cd21-439e-9278-0efaa11451ec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:38.276231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbe37f-cd21-439e-9278-0efaa11451ec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:38.276495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbe37f-cd21-439e-9278-0efaa11451ec None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:38.282822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbe37f-cd21-439e-9278-0efaa11451ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:38.284249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbe37f-cd21-439e-9278-0efaa11451ec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c8bbe37f-cd21-439e-9278-0efaa11451ec None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:38.295426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:38.296666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:38.297862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 580/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 05:21:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:38.303420 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878bfbb-6b53-4d20-b5f0-4382d602f3b8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:38.398452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878bfbb-6b53-4d20-b5f0-4382d602f3b8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:38.431121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54eb9c-f3b0-4efc-8f33-cdcb743427ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:38.431726 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54eb9c-f3b0-4efc-8f33-cdcb743427ec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:38.432001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54eb9c-f3b0-4efc-8f33-cdcb743427ec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:38.432270 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54eb9c-f3b0-4efc-8f33-cdcb743427ec None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:38.432943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54eb9c-f3b0-4efc-8f33-cdcb743427ec None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:38.433270 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54eb9c-f3b0-4efc-8f33-cdcb743427ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:38.434617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54eb9c-f3b0-4efc-8f33-cdcb743427ec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:38.441417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 586/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 05:21:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:40.421286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b786d-c1b9-4f50-982c-0a4d3591b843 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:40.421797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b786d-c1b9-4f50-982c-0a4d3591b843 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:40.421797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b786d-c1b9-4f50-982c-0a4d3591b843 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:40.423333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 581/1167] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:40.428917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf280-d0d1-472d-bf25-decb533ff8d4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:40.429378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf280-d0d1-472d-bf25-decb533ff8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:40.429505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf280-d0d1-472d-bf25-decb533ff8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:40.448308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-177cf280-d0d1-472d-bf25-decb533ff8d4 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:40.449531 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-177cf280-d0d1-472d-bf25-decb533ff8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:40.471518 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:40.514254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 587/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:40.536919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b786d-c1b9-4f50-982c-0a4d3591b843 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:40.634799 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b786d-c1b9-4f50-982c-0a4d3591b843 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:40.649919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:40.666538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb910856-ba03-419a-af88-6b8ab1ee621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:40.667140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910856-ba03-419a-af88-6b8ab1ee621e None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:40.667416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910856-ba03-419a-af88-6b8ab1ee621e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:40.667680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910856-ba03-419a-af88-6b8ab1ee621e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:40.668386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb910856-ba03-419a-af88-6b8ab1ee621e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:40.669790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb910856-ba03-419a-af88-6b8ab1ee621e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:40.722511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 582/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Thu Jul 28 05:21:40 2022] POST /identity/v3/domains => generated 267 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:21:42.767387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f483-b6c7-421a-8773-a81282cfe90c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:42.767915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f483-b6c7-421a-8773-a81282cfe90c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:42.767915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f483-b6c7-421a-8773-a81282cfe90c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:42.769296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 588/1170] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:42.774618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020227-8f4b-40e2-bbed-6dd94f3415de None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:42.775024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020227-8f4b-40e2-bbed-6dd94f3415de None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:42.775178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020227-8f4b-40e2-bbed-6dd94f3415de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:42.792869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b8020227-8f4b-40e2-bbed-6dd94f3415de None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:42.794092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b8020227-8f4b-40e2-bbed-6dd94f3415de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:42.858283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 583/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:42.882220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f483-b6c7-421a-8773-a81282cfe90c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:42.979203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f483-b6c7-421a-8773-a81282cfe90c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:43.011588 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a77e08-3420-4be2-bcc5-31cbd812aeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:43.012204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77e08-3420-4be2-bcc5-31cbd812aeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:43.012481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77e08-3420-4be2-bcc5-31cbd812aeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:43.012750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77e08-3420-4be2-bcc5-31cbd812aeb1 None admin] PATH_INFO: `/v3/domains/30200d62e0b44918b61332bf24c40238` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:43.022948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a77e08-3420-4be2-bcc5-31cbd812aeb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=30200d62e0b44918b61332bf24c40238)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:43.024325 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a77e08-3420-4be2-bcc5-31cbd812aeb1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:43.025920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 589/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 05:21:42 2022] GET /identity/v3/domains/30200d62e0b44918b61332bf24c40238 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:43.031710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8020227-8f4b-40e2-bbed-6dd94f3415de None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:43.129736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8020227-8f4b-40e2-bbed-6dd94f3415de None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:43.136701 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:43.162878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f66ed-00bd-4a45-a9fe-20e9b010d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:43.163493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f66ed-00bd-4a45-a9fe-20e9b010d828 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:43.163772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f66ed-00bd-4a45-a9fe-20e9b010d828 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:43.164041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f66ed-00bd-4a45-a9fe-20e9b010d828 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:43.164722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f66ed-00bd-4a45-a9fe-20e9b010d828 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:43.166223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f66ed-00bd-4a45-a9fe-20e9b010d828 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:43.276722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 584/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:21:43 2022] POST /identity/v3/projects => generated 361 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:21:45.325122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d214a8-817c-4d0a-84c6-391a78c59111 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:45.325651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d214a8-817c-4d0a-84c6-391a78c59111 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:45.325778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d214a8-817c-4d0a-84c6-391a78c59111 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:45.327125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 590/1174] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:45.332301 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8527f-ad85-4cba-9248-fc072715cee4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:45.332697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8527f-ad85-4cba-9248-fc072715cee4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:45.332853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8527f-ad85-4cba-9248-fc072715cee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:45.351230 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-63d8527f-ad85-4cba-9248-fc072715cee4 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:45.352407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-63d8527f-ad85-4cba-9248-fc072715cee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:45.418097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 585/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:45.443352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d214a8-817c-4d0a-84c6-391a78c59111 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:45.462409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:45.542861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d214a8-817c-4d0a-84c6-391a78c59111 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:45.575749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36811470-c95e-4b71-9cf9-fa1af6b179cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:45.576375 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811470-c95e-4b71-9cf9-fa1af6b179cc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:45.576655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811470-c95e-4b71-9cf9-fa1af6b179cc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:45.576926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811470-c95e-4b71-9cf9-fa1af6b179cc None admin] PATH_INFO: `/v3/domains/30200d62e0b44918b61332bf24c40238` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:45.578093 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36811470-c95e-4b71-9cf9-fa1af6b179cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=30200d62e0b44918b61332bf24c40238)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:45.579524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36811470-c95e-4b71-9cf9-fa1af6b179cc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:45.581073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 591/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 05:21:45 2022] GET /identity/v3/domains/30200d62e0b44918b61332bf24c40238 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:45.588014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8527f-ad85-4cba-9248-fc072715cee4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:45.672841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:45.684250 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8527f-ad85-4cba-9248-fc072715cee4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:45.718337 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0974e1e-2151-4974-90cb-5da384702dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:45.719057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0974e1e-2151-4974-90cb-5da384702dcc None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:45.719335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0974e1e-2151-4974-90cb-5da384702dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:45.719602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0974e1e-2151-4974-90cb-5da384702dcc None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:45.720274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0974e1e-2151-4974-90cb-5da384702dcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:45.721731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0974e1e-2151-4974-90cb-5da384702dcc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:45.805573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 586/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:21:45 2022] POST /identity/v3/users => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:21:47.818981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220681-b3c3-4b1e-88b0-51aa8bac72af None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:47.819612 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220681-b3c3-4b1e-88b0-51aa8bac72af None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:47.819612 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220681-b3c3-4b1e-88b0-51aa8bac72af None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:47.820842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 592/1178] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:47.826048 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec8d63-71fc-4d2c-82f8-a0eb67d92781 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:47.826459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec8d63-71fc-4d2c-82f8-a0eb67d92781 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:47.826585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec8d63-71fc-4d2c-82f8-a0eb67d92781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:47.845156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4bec8d63-71fc-4d2c-82f8-a0eb67d92781 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:47.846345 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4bec8d63-71fc-4d2c-82f8-a0eb67d92781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:47.911443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 587/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:47.934762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220681-b3c3-4b1e-88b0-51aa8bac72af None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:48.017438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:48.032279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220681-b3c3-4b1e-88b0-51aa8bac72af None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:48.065219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94787e-408c-4f06-ac29-de9374192b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:48.065843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94787e-408c-4f06-ac29-de9374192b97 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:48.066117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94787e-408c-4f06-ac29-de9374192b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:48.066386 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94787e-408c-4f06-ac29-de9374192b97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:48.076890 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94787e-408c-4f06-ac29-de9374192b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0d94787e-408c-4f06-ac29-de9374192b97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:21:48.081626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:48.082805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:21:48.084809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 593/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:21:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:48.089272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec8d63-71fc-4d2c-82f8-a0eb67d92781 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:48.162361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:48.186817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec8d63-71fc-4d2c-82f8-a0eb67d92781 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:48.220063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a3d70-e816-4ec1-a73b-54dc0ffc1ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:48.220666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a3d70-e816-4ec1-a73b-54dc0ffc1ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:48.220967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a3d70-e816-4ec1-a73b-54dc0ffc1ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:48.221263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a3d70-e816-4ec1-a73b-54dc0ffc1ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:48.221969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a3d70-e816-4ec1-a73b-54dc0ffc1ed6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:48.222267 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a3d70-e816-4ec1-a73b-54dc0ffc1ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:48.224132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a3d70-e816-4ec1-a73b-54dc0ffc1ed6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:48.231836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 588/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:21:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:48.237635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94787e-408c-4f06-ac29-de9374192b97 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:48.337185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94787e-408c-4f06-ac29-de9374192b97 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:48.371063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcc43b-7f9e-403e-9fa6-8cca81183bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:48.371692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcc43b-7f9e-403e-9fa6-8cca81183bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:48.371968 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcc43b-7f9e-403e-9fa6-8cca81183bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:48.372237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcc43b-7f9e-403e-9fa6-8cca81183bb1 None admin] PATH_INFO: `/v3/users/fe1ab682631344bcb51bc98d848f1be6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:48.385771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcc43b-7f9e-403e-9fa6-8cca81183bb1 None admin] RBAC: Authorizing `identity:get_user(user_id=fe1ab682631344bcb51bc98d848f1be6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:48.387202 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcc43b-7f9e-403e-9fa6-8cca81183bb1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:48.388769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 594/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:48 2022] GET /identity/v3/users/fe1ab682631344bcb51bc98d848f1be6 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:48.394564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a3d70-e816-4ec1-a73b-54dc0ffc1ed6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:48.491881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a3d70-e816-4ec1-a73b-54dc0ffc1ed6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:48.573955 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef225b-4089-4eb3-8a79-d83362da3cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:48.574558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef225b-4089-4eb3-8a79-d83362da3cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:48.574834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef225b-4089-4eb3-8a79-d83362da3cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:48.575106 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef225b-4089-4eb3-8a79-d83362da3cc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:48.578404 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:48.640972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef225b-4089-4eb3-8a79-d83362da3cc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:48.642383 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef225b-4089-4eb3-8a79-d83362da3cc8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:48.737256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 589/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:21:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:21:48.743186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcc43b-7f9e-403e-9fa6-8cca81183bb1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:48.746902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:48.840271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcc43b-7f9e-403e-9fa6-8cca81183bb1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:48.873319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc5e10-e0e9-48e2-b569-14f6722269ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:48.873949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5e10-e0e9-48e2-b569-14f6722269ae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:48.874227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5e10-e0e9-48e2-b569-14f6722269ae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:48.874499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc5e10-e0e9-48e2-b569-14f6722269ae None admin] PATH_INFO: `/v3/projects/3e7ca33e76d746ce87128e1aba63731b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:48.875646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc5e10-e0e9-48e2-b569-14f6722269ae None admin] RBAC: Authorizing `identity:get_project(project_id=3e7ca33e76d746ce87128e1aba63731b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:48.877063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc5e10-e0e9-48e2-b569-14f6722269ae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:48.878706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 595/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:48 2022] GET /identity/v3/projects/3e7ca33e76d746ce87128e1aba63731b => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:48.884841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef225b-4089-4eb3-8a79-d83362da3cc8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:48.918680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:48.980862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef225b-4089-4eb3-8a79-d83362da3cc8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:49.014035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797f8ea-dcf0-4308-979a-4d051d88bac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:49.014637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797f8ea-dcf0-4308-979a-4d051d88bac5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:49.014913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797f8ea-dcf0-4308-979a-4d051d88bac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:49.015180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797f8ea-dcf0-4308-979a-4d051d88bac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:49.015958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797f8ea-dcf0-4308-979a-4d051d88bac5 None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=3e7ca33e76d746ce87128e1aba63731b, user.id=fe1ab682631344bcb51bc98d848f1be6) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:49.016263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797f8ea-dcf0-4308-979a-4d051d88bac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:49.017721 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797f8ea-dcf0-4308-979a-4d051d88bac5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:49.023600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 590/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:21:48 2022] GET /identity/v3/role_assignments?user.id=fe1ab682631344bcb51bc98d848f1be6&scope.project.id=3e7ca33e76d746ce87128e1aba63731b&role.id=57a86ff4c9de433399662eebf6893065 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:50.975897 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e8885-3c82-47cf-aacc-d1f86cee9c93 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:50.976459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e8885-3c82-47cf-aacc-d1f86cee9c93 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:50.976459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e8885-3c82-47cf-aacc-d1f86cee9c93 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:50.977840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 596/1186] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:50.982967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb799a-590d-4144-b265-914f6c75fe19 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:50.983395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb799a-590d-4144-b265-914f6c75fe19 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:50.983521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb799a-590d-4144-b265-914f6c75fe19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:51.001811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-45bb799a-590d-4144-b265-914f6c75fe19 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:51.002990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-45bb799a-590d-4144-b265-914f6c75fe19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:51.068219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 591/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:51.089837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e8885-3c82-47cf-aacc-d1f86cee9c93 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:51.158952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:51.189610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e8885-3c82-47cf-aacc-d1f86cee9c93 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:51.222361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a179ae-551a-4d76-90f0-d0d2a2f54845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:51.222983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a179ae-551a-4d76-90f0-d0d2a2f54845 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:51.223771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a179ae-551a-4d76-90f0-d0d2a2f54845 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:51.224056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a179ae-551a-4d76-90f0-d0d2a2f54845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:51.233940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a179ae-551a-4d76-90f0-d0d2a2f54845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-06a179ae-551a-4d76-90f0-d0d2a2f54845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:21:51.238695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:51.240413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:21:51.241549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 597/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:21:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:51.246616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb799a-590d-4144-b265-914f6c75fe19 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:51.275223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:51.343393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb799a-590d-4144-b265-914f6c75fe19 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:51.377189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a224f7d-61d1-4722-a4fc-b14e9cdedbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:51.377800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a224f7d-61d1-4722-a4fc-b14e9cdedbde None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:51.378075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a224f7d-61d1-4722-a4fc-b14e9cdedbde None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:51.378343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a224f7d-61d1-4722-a4fc-b14e9cdedbde None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:51.379048 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a224f7d-61d1-4722-a4fc-b14e9cdedbde None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:51.379348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a224f7d-61d1-4722-a4fc-b14e9cdedbde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:51.380748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a224f7d-61d1-4722-a4fc-b14e9cdedbde None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:51.388504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 592/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:21:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:51.394273 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a179ae-551a-4d76-90f0-d0d2a2f54845 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:51.490941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a179ae-551a-4d76-90f0-d0d2a2f54845 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:51.518576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:51.523303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8c3d4-f0de-4afb-ad9f-147f2ab516d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:51.523937 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8c3d4-f0de-4afb-ad9f-147f2ab516d4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:51.524215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8c3d4-f0de-4afb-ad9f-147f2ab516d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:51.524491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8c3d4-f0de-4afb-ad9f-147f2ab516d4 None admin] PATH_INFO: `/v3/users/fe1ab682631344bcb51bc98d848f1be6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:51.525658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8c3d4-f0de-4afb-ad9f-147f2ab516d4 None admin] RBAC: Authorizing `identity:get_user(user_id=fe1ab682631344bcb51bc98d848f1be6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:51.530192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8c3d4-f0de-4afb-ad9f-147f2ab516d4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:51.530192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 598/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:51 2022] GET /identity/v3/users/fe1ab682631344bcb51bc98d848f1be6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:51.534256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a224f7d-61d1-4722-a4fc-b14e9cdedbde None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:51.622960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:51.631322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a224f7d-61d1-4722-a4fc-b14e9cdedbde None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:51.664767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89cb1b-fed0-4ede-8d5b-33bc2ef12a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:51.665423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89cb1b-fed0-4ede-8d5b-33bc2ef12a47 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:51.665702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89cb1b-fed0-4ede-8d5b-33bc2ef12a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:51.665975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89cb1b-fed0-4ede-8d5b-33bc2ef12a47 None admin] PATH_INFO: `/v3/projects/3e7ca33e76d746ce87128e1aba63731b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:51.667119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89cb1b-fed0-4ede-8d5b-33bc2ef12a47 None admin] RBAC: Authorizing `identity:get_project(project_id=3e7ca33e76d746ce87128e1aba63731b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:51.668543 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89cb1b-fed0-4ede-8d5b-33bc2ef12a47 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:51.670216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 593/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:51 2022] GET /identity/v3/projects/3e7ca33e76d746ce87128e1aba63731b => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:51.676394 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8c3d4-f0de-4afb-ad9f-147f2ab516d4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:51.771824 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8c3d4-f0de-4afb-ad9f-147f2ab516d4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:51.804213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872b7fc-6d28-464f-bac1-3dd8840c62b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:51.804860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872b7fc-6d28-464f-bac1-3dd8840c62b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:51.805161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872b7fc-6d28-464f-bac1-3dd8840c62b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:51.805433 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872b7fc-6d28-464f-bac1-3dd8840c62b8 None admin] PATH_INFO: `/v3/projects/3e7ca33e76d746ce87128e1aba63731b/users/fe1ab682631344bcb51bc98d848f1be6/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:51.807316 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872b7fc-6d28-464f-bac1-3dd8840c62b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e7ca33e76d746ce87128e1aba63731b, user_id=fe1ab682631344bcb51bc98d848f1be6, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:51.808734 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872b7fc-6d28-464f-bac1-3dd8840c62b8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:51.880040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 599/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:21:51 2022] PUT /identity/v3/projects/3e7ca33e76d746ce87128e1aba63731b/users/fe1ab682631344bcb51bc98d848f1be6/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:21:53.882723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc98e9c-3656-4906-a338-e2b5ff2f4d9c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:53.883249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc98e9c-3656-4906-a338-e2b5ff2f4d9c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:53.883249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc98e9c-3656-4906-a338-e2b5ff2f4d9c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:53.884608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 594/1193] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:21:53.889789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae87f0-bcdb-4147-bf53-26168e773ff2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:53.890162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae87f0-bcdb-4147-bf53-26168e773ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:53.890347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae87f0-bcdb-4147-bf53-26168e773ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:53.908585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-86ae87f0-bcdb-4147-bf53-26168e773ff2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:21:53.909801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-86ae87f0-bcdb-4147-bf53-26168e773ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:21:53.964925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:53.976490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 600/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:21:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:21:53.999442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc98e9c-3656-4906-a338-e2b5ff2f4d9c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:54.100327 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc98e9c-3656-4906-a338-e2b5ff2f4d9c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:54.132145 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02575979-fa3d-4c7d-b118-e43664979e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:54.132818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02575979-fa3d-4c7d-b118-e43664979e91 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:54.133045 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02575979-fa3d-4c7d-b118-e43664979e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:54.133341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02575979-fa3d-4c7d-b118-e43664979e91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:54.143426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02575979-fa3d-4c7d-b118-e43664979e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-02575979-fa3d-4c7d-b118-e43664979e91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:21:54.148839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:21:54.150020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:21:54.151264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 595/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:21:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:21:54.156055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae87f0-bcdb-4147-bf53-26168e773ff2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:54.251012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae87f0-bcdb-4147-bf53-26168e773ff2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:54.284448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e7c85-e0f9-4c61-9789-3d5a70ebcd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:54.285055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e7c85-e0f9-4c61-9789-3d5a70ebcd7b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:54.285359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e7c85-e0f9-4c61-9789-3d5a70ebcd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:54.285651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e7c85-e0f9-4c61-9789-3d5a70ebcd7b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:54.286351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e7c85-e0f9-4c61-9789-3d5a70ebcd7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:54.286649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e7c85-e0f9-4c61-9789-3d5a70ebcd7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:54.288011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e7c85-e0f9-4c61-9789-3d5a70ebcd7b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:54.295714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 601/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:21:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:54.301915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02575979-fa3d-4c7d-b118-e43664979e91 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:54.324275 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:54.398623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02575979-fa3d-4c7d-b118-e43664979e91 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:54.429997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bf051-0ccf-4b01-9e90-8671efa9c260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:54.430618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bf051-0ccf-4b01-9e90-8671efa9c260 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:54.430893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bf051-0ccf-4b01-9e90-8671efa9c260 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:54.431162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bf051-0ccf-4b01-9e90-8671efa9c260 None admin] PATH_INFO: `/v3/users/fe1ab682631344bcb51bc98d848f1be6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:54.432297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bf051-0ccf-4b01-9e90-8671efa9c260 None admin] RBAC: Authorizing `identity:get_user(user_id=fe1ab682631344bcb51bc98d848f1be6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:54.433754 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bf051-0ccf-4b01-9e90-8671efa9c260 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:54.435323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 596/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 05:21:54 2022] GET /identity/v3/users/fe1ab682631344bcb51bc98d848f1be6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:54.441084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e7c85-e0f9-4c61-9789-3d5a70ebcd7b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:54.493780 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:54.540843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e7c85-e0f9-4c61-9789-3d5a70ebcd7b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:54.573493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceebcbe-b731-42ff-bf35-ff08538412ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:54.574096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebcbe-b731-42ff-bf35-ff08538412ad None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:54.574379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebcbe-b731-42ff-bf35-ff08538412ad None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:54.574654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebcbe-b731-42ff-bf35-ff08538412ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:54.639980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceebcbe-b731-42ff-bf35-ff08538412ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:54.641442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceebcbe-b731-42ff-bf35-ff08538412ad None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:54.690037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:54.736930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 602/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:21:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:21:54.743337 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bf051-0ccf-4b01-9e90-8671efa9c260 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:54.829100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:21:54.840457 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bf051-0ccf-4b01-9e90-8671efa9c260 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:54.873584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e0519-65dd-4a84-89fc-ea91f0f6fa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:54.874206 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e0519-65dd-4a84-89fc-ea91f0f6fa53 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:54.874483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e0519-65dd-4a84-89fc-ea91f0f6fa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:54.874753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e0519-65dd-4a84-89fc-ea91f0f6fa53 None admin] PATH_INFO: `/v3/projects/3e7ca33e76d746ce87128e1aba63731b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:54.875882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e0519-65dd-4a84-89fc-ea91f0f6fa53 None admin] RBAC: Authorizing `identity:get_project(project_id=3e7ca33e76d746ce87128e1aba63731b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:54.877338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e0519-65dd-4a84-89fc-ea91f0f6fa53 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:54.878963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 597/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 05:21:54 2022] GET /identity/v3/projects/3e7ca33e76d746ce87128e1aba63731b => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:21:54.885567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceebcbe-b731-42ff-bf35-ff08538412ad None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:21:54.981562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceebcbe-b731-42ff-bf35-ff08538412ad None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:21:55.014246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30a9f9-0a34-466b-85ee-f5dde38b8826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:21:55.014845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30a9f9-0a34-466b-85ee-f5dde38b8826 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:21:55.015127 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30a9f9-0a34-466b-85ee-f5dde38b8826 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:21:55.015401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30a9f9-0a34-466b-85ee-f5dde38b8826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:21:55.016179 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30a9f9-0a34-466b-85ee-f5dde38b8826 None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=3e7ca33e76d746ce87128e1aba63731b, user.id=fe1ab682631344bcb51bc98d848f1be6) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:21:55.016485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30a9f9-0a34-466b-85ee-f5dde38b8826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:21:55.017931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30a9f9-0a34-466b-85ee-f5dde38b8826 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:21:55.023648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 603/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:21:54 2022] GET /identity/v3/role_assignments?user.id=fe1ab682631344bcb51bc98d848f1be6&scope.project.id=3e7ca33e76d746ce87128e1aba63731b&role.id=57a86ff4c9de433399662eebf6893065 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:22:04.869509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=22 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:22:05.020968 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:06.007300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b059d1-9348-4b59-9c37-f63b8cce64df None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:06.007940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b059d1-9348-4b59-9c37-f63b8cce64df None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:06.007940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b059d1-9348-4b59-9c37-f63b8cce64df None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:06.009356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 598/1201] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:06.014560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99929434-4ea1-423c-bcb7-2f1d71976cd1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:06.014977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99929434-4ea1-423c-bcb7-2f1d71976cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:06.015096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99929434-4ea1-423c-bcb7-2f1d71976cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:06.033713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-99929434-4ea1-423c-bcb7-2f1d71976cd1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:06.034932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-99929434-4ea1-423c-bcb7-2f1d71976cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:06.100833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 604/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:23:06.125481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b059d1-9348-4b59-9c37-f63b8cce64df None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:06.231795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b059d1-9348-4b59-9c37-f63b8cce64df None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:06.265776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637f5f-deb6-402c-bf44-de4b04610fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:06.266353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637f5f-deb6-402c-bf44-de4b04610fed None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:06.266634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637f5f-deb6-402c-bf44-de4b04610fed None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:06.266908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637f5f-deb6-402c-bf44-de4b04610fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:06.277358 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5637f5f-deb6-402c-bf44-de4b04610fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:06.278802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5637f5f-deb6-402c-bf44-de4b04610fed None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c5637f5f-deb6-402c-bf44-de4b04610fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:06.293986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:06.300464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:06.301682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:06.301682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:06.301682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:06.301682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:06.301682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 599/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:06.302493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99929434-4ea1-423c-bcb7-2f1d71976cd1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:06.403462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99929434-4ea1-423c-bcb7-2f1d71976cd1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:06.434057 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:06.439403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a3c56-3d5d-4f65-981e-a92dd71e9b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:06.440026 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3c56-3d5d-4f65-981e-a92dd71e9b07 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:06.440295 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3c56-3d5d-4f65-981e-a92dd71e9b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:06.440626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3c56-3d5d-4f65-981e-a92dd71e9b07 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:06.441317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a3c56-3d5d-4f65-981e-a92dd71e9b07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:06.441622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a3c56-3d5d-4f65-981e-a92dd71e9b07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:06.442982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a3c56-3d5d-4f65-981e-a92dd71e9b07 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:06.453987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 605/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:06.460306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637f5f-deb6-402c-bf44-de4b04610fed None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:06.512711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:06.559339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637f5f-deb6-402c-bf44-de4b04610fed None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:06.592546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07773997-60ef-4b89-b068-22999cc58bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:06.593180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773997-60ef-4b89-b068-22999cc58bb9 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:06.593466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773997-60ef-4b89-b068-22999cc58bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:06.593737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773997-60ef-4b89-b068-22999cc58bb9 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:06.594414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07773997-60ef-4b89-b068-22999cc58bb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:06.596470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07773997-60ef-4b89-b068-22999cc58bb9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:06.723039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 600/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 05:23:06 2022] POST /identity/v3/users => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:23:08.773676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d758df-3276-4265-8e77-3dad94e963a5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:08.774220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d758df-3276-4265-8e77-3dad94e963a5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:08.774320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d758df-3276-4265-8e77-3dad94e963a5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:08.775665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 606/1206] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:08.780853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b47a34-cc0b-4f2f-848d-8ce73bb53d85 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:08.781299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b47a34-cc0b-4f2f-848d-8ce73bb53d85 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:08.781422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b47a34-cc0b-4f2f-848d-8ce73bb53d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:08.800908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-76b47a34-cc0b-4f2f-848d-8ce73bb53d85 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:08.802112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-76b47a34-cc0b-4f2f-848d-8ce73bb53d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:08.868631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 601/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:23:08.892232 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d758df-3276-4265-8e77-3dad94e963a5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:08.991463 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d758df-3276-4265-8e77-3dad94e963a5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:09.024501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73630d57-d26c-4a1c-9f30-99ac0db7b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:09.025044 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73630d57-d26c-4a1c-9f30-99ac0db7b20c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:09.025359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73630d57-d26c-4a1c-9f30-99ac0db7b20c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:09.025631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73630d57-d26c-4a1c-9f30-99ac0db7b20c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:09.035605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73630d57-d26c-4a1c-9f30-99ac0db7b20c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-73630d57-d26c-4a1c-9f30-99ac0db7b20c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:23:09.040434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:09.041650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:09.043066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 607/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:23:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:09.048049 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b47a34-cc0b-4f2f-848d-8ce73bb53d85 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:09.089113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:09.147657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b47a34-cc0b-4f2f-848d-8ce73bb53d85 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:09.182298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b91de-493f-480d-ae70-17dad6e8fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:09.183024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b91de-493f-480d-ae70-17dad6e8fab4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:09.183308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b91de-493f-480d-ae70-17dad6e8fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:09.183573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b91de-493f-480d-ae70-17dad6e8fab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:09.184283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b91de-493f-480d-ae70-17dad6e8fab4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:09.184581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b91de-493f-480d-ae70-17dad6e8fab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:09.185988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b91de-493f-480d-ae70-17dad6e8fab4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:09.194363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 602/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:23:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:09.200521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73630d57-d26c-4a1c-9f30-99ac0db7b20c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:09.250641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:09.300906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73630d57-d26c-4a1c-9f30-99ac0db7b20c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:09.334475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b94c3-0fee-4eb0-b69f-de524ff49b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:09.335113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b94c3-0fee-4eb0-b69f-de524ff49b57 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:09.335392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b94c3-0fee-4eb0-b69f-de524ff49b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:09.335660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b94c3-0fee-4eb0-b69f-de524ff49b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:09.346015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b94c3-0fee-4eb0-b69f-de524ff49b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:09.347574 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b94c3-0fee-4eb0-b69f-de524ff49b57 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0c9b94c3-0fee-4eb0-b69f-de524ff49b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:09.362016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:09.363158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:09.364102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:09.364102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:09.364102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:09.364102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:09.364102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 608/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:09.369100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b91de-493f-480d-ae70-17dad6e8fab4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:09.466499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:09.469358 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b91de-493f-480d-ae70-17dad6e8fab4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:09.502582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f9413-77ff-4cd5-93f8-e9f7a4c3db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:09.503223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9413-77ff-4cd5-93f8-e9f7a4c3db48 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:09.503539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9413-77ff-4cd5-93f8-e9f7a4c3db48 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:09.503813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9413-77ff-4cd5-93f8-e9f7a4c3db48 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:09.504496 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f9413-77ff-4cd5-93f8-e9f7a4c3db48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:09.504796 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f9413-77ff-4cd5-93f8-e9f7a4c3db48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:09.506196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f9413-77ff-4cd5-93f8-e9f7a4c3db48 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:09.518854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 603/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:09.524765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b94c3-0fee-4eb0-b69f-de524ff49b57 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:09.623313 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b94c3-0fee-4eb0-b69f-de524ff49b57 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:09.624833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:09.656613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36795e7c-faa4-4c71-b6a9-8898f90bea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:09.657284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795e7c-faa4-4c71-b6a9-8898f90bea28 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:09.657602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795e7c-faa4-4c71-b6a9-8898f90bea28 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:09.657898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795e7c-faa4-4c71-b6a9-8898f90bea28 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:09.665323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36795e7c-faa4-4c71-b6a9-8898f90bea28 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:09.666787 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36795e7c-faa4-4c71-b6a9-8898f90bea28 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-36795e7c-faa4-4c71-b6a9-8898f90bea28 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:23:09.680102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:09.681317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:09.682623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:09.682623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:09.682623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:23:09.682623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:23:09.682623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:23:09.682623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:23:09.682623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:23:09.682623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:23:09.682623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:09.682623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:09.682623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 609/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:09.687186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f9413-77ff-4cd5-93f8-e9f7a4c3db48 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:09.786387 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f9413-77ff-4cd5-93f8-e9f7a4c3db48 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:09.820341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575dca7-7f28-4d66-8ac6-46ffd424125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:09.820940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575dca7-7f28-4d66-8ac6-46ffd424125f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:09.821238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575dca7-7f28-4d66-8ac6-46ffd424125f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:09.821506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575dca7-7f28-4d66-8ac6-46ffd424125f None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:09.822282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575dca7-7f28-4d66-8ac6-46ffd424125f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:09.822580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575dca7-7f28-4d66-8ac6-46ffd424125f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:09.824081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575dca7-7f28-4d66-8ac6-46ffd424125f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:09.840781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 604/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 05:23:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:09.846967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36795e7c-faa4-4c71-b6a9-8898f90bea28 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:09.946834 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36795e7c-faa4-4c71-b6a9-8898f90bea28 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:09.980243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a7c9f-915e-4004-bccd-7b1dcb99f0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:09.980847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a7c9f-915e-4004-bccd-7b1dcb99f0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:09.981122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a7c9f-915e-4004-bccd-7b1dcb99f0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:09.981419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a7c9f-915e-4004-bccd-7b1dcb99f0e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:10.010787 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:10.047837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a7c9f-915e-4004-bccd-7b1dcb99f0e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:10.050264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a7c9f-915e-4004-bccd-7b1dcb99f0e2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:10.146201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 610/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:23:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:23:10.151972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575dca7-7f28-4d66-8ac6-46ffd424125f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:10.172336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:10.250362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575dca7-7f28-4d66-8ac6-46ffd424125f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:10.284340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb557e01-5eda-4583-b97d-e0cfeaae1550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:10.284972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb557e01-5eda-4583-b97d-e0cfeaae1550 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:10.285286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb557e01-5eda-4583-b97d-e0cfeaae1550 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:10.285561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb557e01-5eda-4583-b97d-e0cfeaae1550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:10.295891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb557e01-5eda-4583-b97d-e0cfeaae1550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:10.297423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb557e01-5eda-4583-b97d-e0cfeaae1550 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fb557e01-5eda-4583-b97d-e0cfeaae1550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:10.313298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:10.315229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:10.316490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:10.316490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:10.316490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:10.316490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:10.316490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 605/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:10.320947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a7c9f-915e-4004-bccd-7b1dcb99f0e2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:10.380805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:10.418125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a7c9f-915e-4004-bccd-7b1dcb99f0e2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:10.452514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d939522-604e-483c-8fd4-e71a4e261fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:10.453122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d939522-604e-483c-8fd4-e71a4e261fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:10.453432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d939522-604e-483c-8fd4-e71a4e261fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:10.453705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d939522-604e-483c-8fd4-e71a4e261fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:10.454411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d939522-604e-483c-8fd4-e71a4e261fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:10.454716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d939522-604e-483c-8fd4-e71a4e261fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:10.456086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d939522-604e-483c-8fd4-e71a4e261fe3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:10.467574 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 611/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:10.473673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb557e01-5eda-4583-b97d-e0cfeaae1550 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:10.541662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:10.572124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb557e01-5eda-4583-b97d-e0cfeaae1550 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:10.605247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f51de8-efdf-4614-8158-e035eb33ad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:10.605916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51de8-efdf-4614-8158-e035eb33ad50 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:10.606191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51de8-efdf-4614-8158-e035eb33ad50 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:10.606457 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51de8-efdf-4614-8158-e035eb33ad50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:10.613419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f51de8-efdf-4614-8158-e035eb33ad50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:10.614849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f51de8-efdf-4614-8158-e035eb33ad50 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b8f51de8-efdf-4614-8158-e035eb33ad50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:23:10.625714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:10.627926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:10.628997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:23:10.628997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:23:10.628997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:23:10.628997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:23:10.628997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:23:10.628997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:23:10.628997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:10.628997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:10.628997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 606/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:23:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:10.633635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d939522-604e-483c-8fd4-e71a4e261fe3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:10.733696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d939522-604e-483c-8fd4-e71a4e261fe3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:10.756688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:10.768199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d860279-c0b4-4060-bfde-7e824ba70755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:10.768809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d860279-c0b4-4060-bfde-7e824ba70755 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:10.769091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d860279-c0b4-4060-bfde-7e824ba70755 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:10.769390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d860279-c0b4-4060-bfde-7e824ba70755 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:10.770120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d860279-c0b4-4060-bfde-7e824ba70755 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:10.770419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d860279-c0b4-4060-bfde-7e824ba70755 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:10.771889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d860279-c0b4-4060-bfde-7e824ba70755 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:10.782840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 612/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:23:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:10.789179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f51de8-efdf-4614-8158-e035eb33ad50 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:10.886901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f51de8-efdf-4614-8158-e035eb33ad50 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:10.914388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:10.920229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cb1f6-3f04-4f32-896a-7234b7838395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:10.920874 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cb1f6-3f04-4f32-896a-7234b7838395 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:10.921170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cb1f6-3f04-4f32-896a-7234b7838395 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:10.921443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cb1f6-3f04-4f32-896a-7234b7838395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:10.922214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cb1f6-3f04-4f32-896a-7234b7838395 None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=a5593bc41bce41b4b44616c355976cc9) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:10.922516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cb1f6-3f04-4f32-896a-7234b7838395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:10.924523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cb1f6-3f04-4f32-896a-7234b7838395 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:10.929758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 607/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:23:10 2022] GET /identity/v3/role_assignments?user.id=a5593bc41bce41b4b44616c355976cc9&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:12.936269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14abc72-cabc-47fd-addf-4b648a262892 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:12.936822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14abc72-cabc-47fd-addf-4b648a262892 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:12.936936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14abc72-cabc-47fd-addf-4b648a262892 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:12.938350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 613/1220] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:12.943985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13646069-2d78-4b24-91b6-264960e1047f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:12.944405 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13646069-2d78-4b24-91b6-264960e1047f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:12.944529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13646069-2d78-4b24-91b6-264960e1047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:12.962905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-13646069-2d78-4b24-91b6-264960e1047f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:12.964066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-13646069-2d78-4b24-91b6-264960e1047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:13.029537 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 608/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:23:13.053494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14abc72-cabc-47fd-addf-4b648a262892 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:13.154349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14abc72-cabc-47fd-addf-4b648a262892 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:13.189840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973b35c-1326-4553-bf45-a3de5aa55029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:13.190411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b35c-1326-4553-bf45-a3de5aa55029 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:13.190690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b35c-1326-4553-bf45-a3de5aa55029 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:13.190959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b35c-1326-4553-bf45-a3de5aa55029 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:13.200815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973b35c-1326-4553-bf45-a3de5aa55029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4973b35c-1326-4553-bf45-a3de5aa55029 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:23:13.205809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:13.206952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:13.208046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 614/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:23:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:13.213118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13646069-2d78-4b24-91b6-264960e1047f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:13.312836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13646069-2d78-4b24-91b6-264960e1047f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:13.337146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:13.347824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae872b2-66f7-471b-96db-a83cf64e98b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:13.348544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae872b2-66f7-471b-96db-a83cf64e98b0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:13.348825 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae872b2-66f7-471b-96db-a83cf64e98b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:13.349098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae872b2-66f7-471b-96db-a83cf64e98b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:13.349836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae872b2-66f7-471b-96db-a83cf64e98b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:13.350138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae872b2-66f7-471b-96db-a83cf64e98b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:13.351512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae872b2-66f7-471b-96db-a83cf64e98b0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:13.359277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 609/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:23:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:13.365548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973b35c-1326-4553-bf45-a3de5aa55029 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:13.409660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:13.463600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973b35c-1326-4553-bf45-a3de5aa55029 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:13.496179 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77baec-d790-402f-8df5-7a109c04336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:13.496808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77baec-d790-402f-8df5-7a109c04336f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:13.497088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77baec-d790-402f-8df5-7a109c04336f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:13.497393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77baec-d790-402f-8df5-7a109c04336f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:13.507747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77baec-d790-402f-8df5-7a109c04336f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:13.509230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77baec-d790-402f-8df5-7a109c04336f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6e77baec-d790-402f-8df5-7a109c04336f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:13.523826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:13.524920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:13.525967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:13.525967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:13.525967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:13.525967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:13.529318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 615/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:13.530628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae872b2-66f7-471b-96db-a83cf64e98b0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:13.632058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae872b2-66f7-471b-96db-a83cf64e98b0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:13.665627 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2d918-b1f0-4a17-a645-d2bef711efc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:13.666235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2d918-b1f0-4a17-a645-d2bef711efc6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:13.666515 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2d918-b1f0-4a17-a645-d2bef711efc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:13.667044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2d918-b1f0-4a17-a645-d2bef711efc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:13.667731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2d918-b1f0-4a17-a645-d2bef711efc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:13.668032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2d918-b1f0-4a17-a645-d2bef711efc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:13.669421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2d918-b1f0-4a17-a645-d2bef711efc6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:13.682262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 610/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:13.687972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77baec-d790-402f-8df5-7a109c04336f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:13.781040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:13.787917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77baec-d790-402f-8df5-7a109c04336f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:13.821773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e4f00-a3d1-469a-8b70-475561846c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:13.822398 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4f00-a3d1-469a-8b70-475561846c56 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:13.822672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4f00-a3d1-469a-8b70-475561846c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:13.822937 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e4f00-a3d1-469a-8b70-475561846c56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:13.831185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e4f00-a3d1-469a-8b70-475561846c56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:13.833025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e4f00-a3d1-469a-8b70-475561846c56 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7f5e4f00-a3d1-469a-8b70-475561846c56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:23:13.844025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:13.845954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:13.847351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:13.847351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:13.847351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:23:13.847351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:23:13.847351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:23:13.847351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:23:13.847351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:23:13.847351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:23:13.847351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:13.847351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:13.847351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 616/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:13.852009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2d918-b1f0-4a17-a645-d2bef711efc6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:13.898763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:13.950536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2d918-b1f0-4a17-a645-d2bef711efc6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:13.982933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc885178-6442-42a1-beb3-41e782c9aa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:13.983538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc885178-6442-42a1-beb3-41e782c9aa78 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:13.983812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc885178-6442-42a1-beb3-41e782c9aa78 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:13.984079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc885178-6442-42a1-beb3-41e782c9aa78 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:13.984853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc885178-6442-42a1-beb3-41e782c9aa78 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:13.985172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc885178-6442-42a1-beb3-41e782c9aa78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:13.987387 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc885178-6442-42a1-beb3-41e782c9aa78 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:14.004758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 611/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 05:23:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:14.010586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e4f00-a3d1-469a-8b70-475561846c56 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:14.110401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e4f00-a3d1-469a-8b70-475561846c56 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:14.143314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa52dcc-602d-4f82-a39e-2940d6526c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:14.143982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52dcc-602d-4f82-a39e-2940d6526c2a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:14.144258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52dcc-602d-4f82-a39e-2940d6526c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:14.144653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52dcc-602d-4f82-a39e-2940d6526c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:14.155782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa52dcc-602d-4f82-a39e-2940d6526c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:14.157367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa52dcc-602d-4f82-a39e-2940d6526c2a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3aa52dcc-602d-4f82-a39e-2940d6526c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:14.172448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:14.174070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:14.175014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:14.175014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:14.175014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:14.175014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:14.175014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 617/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:14.179258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc885178-6442-42a1-beb3-41e782c9aa78 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:14.278177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc885178-6442-42a1-beb3-41e782c9aa78 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:14.280601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:14.311876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d9926-3061-4cb8-a727-57f63d56c7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:14.312505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d9926-3061-4cb8-a727-57f63d56c7da None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:14.312778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d9926-3061-4cb8-a727-57f63d56c7da None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:14.313043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d9926-3061-4cb8-a727-57f63d56c7da None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:14.313798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d9926-3061-4cb8-a727-57f63d56c7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:14.314268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d9926-3061-4cb8-a727-57f63d56c7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:14.315635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d9926-3061-4cb8-a727-57f63d56c7da None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:14.326349 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 612/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:14.332483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa52dcc-602d-4f82-a39e-2940d6526c2a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:14.341730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:14.431774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa52dcc-602d-4f82-a39e-2940d6526c2a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:14.464987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8890127-6bc7-49ec-8061-20eae5b68557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:14.465652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8890127-6bc7-49ec-8061-20eae5b68557 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:14.465926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8890127-6bc7-49ec-8061-20eae5b68557 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:14.466190 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8890127-6bc7-49ec-8061-20eae5b68557 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:14.473541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8890127-6bc7-49ec-8061-20eae5b68557 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:14.474958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8890127-6bc7-49ec-8061-20eae5b68557 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a8890127-6bc7-49ec-8061-20eae5b68557 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:23:14.487083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:14.488154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:14.489282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:23:14.489282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:23:14.489282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:23:14.489282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:23:14.489282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:23:14.489282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:23:14.489282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:14.489282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:14.489282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 618/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:14.494078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d9926-3061-4cb8-a727-57f63d56c7da None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:14.594080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d9926-3061-4cb8-a727-57f63d56c7da None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:14.628429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6af5f5-fa98-4ad5-9166-f59b910ebbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:14.629093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6af5f5-fa98-4ad5-9166-f59b910ebbee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:14.629404 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6af5f5-fa98-4ad5-9166-f59b910ebbee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:14.629680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6af5f5-fa98-4ad5-9166-f59b910ebbee None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:14.630428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6af5f5-fa98-4ad5-9166-f59b910ebbee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:14.630736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6af5f5-fa98-4ad5-9166-f59b910ebbee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:14.632205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6af5f5-fa98-4ad5-9166-f59b910ebbee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:14.644597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 613/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:14.650681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8890127-6bc7-49ec-8061-20eae5b68557 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:14.716345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:14.750302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8890127-6bc7-49ec-8061-20eae5b68557 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:14.783445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac5895-d201-4c10-968d-06dbbe729454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:14.784106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac5895-d201-4c10-968d-06dbbe729454 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:14.784387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac5895-d201-4c10-968d-06dbbe729454 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:14.784661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac5895-d201-4c10-968d-06dbbe729454 None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/a5593bc41bce41b4b44616c355976cc9/roles/32be7893438b4f25a422f68ef7c24fef` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:14.799178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac5895-d201-4c10-968d-06dbbe729454 None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=a5593bc41bce41b4b44616c355976cc9, role_id=32be7893438b4f25a422f68ef7c24fef)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:14.800707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac5895-d201-4c10-968d-06dbbe729454 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:14.903315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 619/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:23:14 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/a5593bc41bce41b4b44616c355976cc9/roles/32be7893438b4f25a422f68ef7c24fef => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:23:16.861089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb652a-4b3d-4e00-ab18-ca7223d4e141 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:16.861667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb652a-4b3d-4e00-ab18-ca7223d4e141 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:16.861667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb652a-4b3d-4e00-ab18-ca7223d4e141 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:16.863033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 614/1233] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:16.868161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa9541-8c16-47ed-84db-2cfeacfefe74 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:16.868560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa9541-8c16-47ed-84db-2cfeacfefe74 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:16.868712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa9541-8c16-47ed-84db-2cfeacfefe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:16.887421 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a9aa9541-8c16-47ed-84db-2cfeacfefe74 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:16.888602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a9aa9541-8c16-47ed-84db-2cfeacfefe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:16.954767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 620/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:23:16.977983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb652a-4b3d-4e00-ab18-ca7223d4e141 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:17.003820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:17.079603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb652a-4b3d-4e00-ab18-ca7223d4e141 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:17.113190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd5991-974b-43b8-a10a-1feb978827cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:17.113751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd5991-974b-43b8-a10a-1feb978827cc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:17.114080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd5991-974b-43b8-a10a-1feb978827cc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:17.114339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd5991-974b-43b8-a10a-1feb978827cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:17.124067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd5991-974b-43b8-a10a-1feb978827cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b3cd5991-974b-43b8-a10a-1feb978827cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:23:17.128945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:17.130111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:17.131229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 615/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 05:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:17.136458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa9541-8c16-47ed-84db-2cfeacfefe74 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:17.183668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:17.236999 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa9541-8c16-47ed-84db-2cfeacfefe74 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:17.269907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f9ed0-eb91-4a7a-8ab0-09e21e972117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:17.270521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9ed0-eb91-4a7a-8ab0-09e21e972117 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:17.270802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9ed0-eb91-4a7a-8ab0-09e21e972117 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:17.271075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9ed0-eb91-4a7a-8ab0-09e21e972117 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:17.271783 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f9ed0-eb91-4a7a-8ab0-09e21e972117 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:17.272087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f9ed0-eb91-4a7a-8ab0-09e21e972117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:17.273656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f9ed0-eb91-4a7a-8ab0-09e21e972117 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:17.281235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 621/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 05:23:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:17.287660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd5991-974b-43b8-a10a-1feb978827cc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:17.373085 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:17.388153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd5991-974b-43b8-a10a-1feb978827cc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:17.423690 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7b7b-9053-4c82-a9a5-045ced2d8b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:17.424324 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7b7b-9053-4c82-a9a5-045ced2d8b1a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:17.424602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7b7b-9053-4c82-a9a5-045ced2d8b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:17.424873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7b7b-9053-4c82-a9a5-045ced2d8b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:17.435224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad7b7b-9053-4c82-a9a5-045ced2d8b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:17.436657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad7b7b-9053-4c82-a9a5-045ced2d8b1a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-05ad7b7b-9053-4c82-a9a5-045ced2d8b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:17.451386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:17.452479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:17.453842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:17.453842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:17.453842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:17.453842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:17.453842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 616/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:17.458937 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f9ed0-eb91-4a7a-8ab0-09e21e972117 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:17.557627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f9ed0-eb91-4a7a-8ab0-09e21e972117 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:17.566827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:17.590991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a1634-bb91-4114-8c67-33440eb48ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:17.591600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1634-bb91-4114-8c67-33440eb48ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:17.591877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1634-bb91-4114-8c67-33440eb48ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:17.592147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1634-bb91-4114-8c67-33440eb48ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:17.592828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a1634-bb91-4114-8c67-33440eb48ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:17.593160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a1634-bb91-4114-8c67-33440eb48ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:17.594679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a1634-bb91-4114-8c67-33440eb48ec9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:17.606181 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 622/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:17.611868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7b7b-9053-4c82-a9a5-045ced2d8b1a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:17.711623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7b7b-9053-4c82-a9a5-045ced2d8b1a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:17.743780 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a427a60-dc9a-4e51-99ab-acce088ba465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:17.744421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a427a60-dc9a-4e51-99ab-acce088ba465 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:17.744680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a427a60-dc9a-4e51-99ab-acce088ba465 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:17.744948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a427a60-dc9a-4e51-99ab-acce088ba465 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:17.747706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:17.753221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a427a60-dc9a-4e51-99ab-acce088ba465 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:17.754649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a427a60-dc9a-4e51-99ab-acce088ba465 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4a427a60-dc9a-4e51-99ab-acce088ba465 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:23:17.765704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:17.771529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:17.772660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:17.772660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:17.772660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:23:17.772660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:23:17.772660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:23:17.772660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:23:17.772660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:23:17.772660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:23:17.772660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:17.772660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:17.772660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 617/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:17.773631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a1634-bb91-4114-8c67-33440eb48ec9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:17.871418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a1634-bb91-4114-8c67-33440eb48ec9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:17.905545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578b8cc-6420-4b06-8ecc-5f3e1aa68b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:17.906164 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578b8cc-6420-4b06-8ecc-5f3e1aa68b91 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:17.906451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578b8cc-6420-4b06-8ecc-5f3e1aa68b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:17.906721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578b8cc-6420-4b06-8ecc-5f3e1aa68b91 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:17.907682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578b8cc-6420-4b06-8ecc-5f3e1aa68b91 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:17.908013 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578b8cc-6420-4b06-8ecc-5f3e1aa68b91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:17.909499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578b8cc-6420-4b06-8ecc-5f3e1aa68b91 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:17.927420 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 623/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 05:23:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:23:17.933207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a427a60-dc9a-4e51-99ab-acce088ba465 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:18.031643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a427a60-dc9a-4e51-99ab-acce088ba465 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:18.065670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe255e-5be5-491b-a4ab-b6d4feb6e411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:18.066269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe255e-5be5-491b-a4ab-b6d4feb6e411 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:18.066542 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe255e-5be5-491b-a4ab-b6d4feb6e411 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:18.066808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe255e-5be5-491b-a4ab-b6d4feb6e411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:18.127146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:18.134212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe255e-5be5-491b-a4ab-b6d4feb6e411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:18.135665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe255e-5be5-491b-a4ab-b6d4feb6e411 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:18.233683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 618/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:23:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:23:18.239615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578b8cc-6420-4b06-8ecc-5f3e1aa68b91 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:18.267550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:18.338685 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578b8cc-6420-4b06-8ecc-5f3e1aa68b91 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:18.373694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a666f-2f41-4d09-a97d-d0145aaadd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:18.374337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a666f-2f41-4d09-a97d-d0145aaadd62 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:18.374619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a666f-2f41-4d09-a97d-d0145aaadd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:18.374893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a666f-2f41-4d09-a97d-d0145aaadd62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:18.385083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a666f-2f41-4d09-a97d-d0145aaadd62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:18.386662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a666f-2f41-4d09-a97d-d0145aaadd62 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b29a666f-2f41-4d09-a97d-d0145aaadd62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:18.401020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:18.402060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:18.403012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:18.403012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:18.403012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:18.403012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:18.403012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 624/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:18.408710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe255e-5be5-491b-a4ab-b6d4feb6e411 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:18.502159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:18.507744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe255e-5be5-491b-a4ab-b6d4feb6e411 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:18.542076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7f358-3576-4f93-bd49-3e5e2a57a0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:18.542794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7f358-3576-4f93-bd49-3e5e2a57a0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:18.543076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7f358-3576-4f93-bd49-3e5e2a57a0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:18.543354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7f358-3576-4f93-bd49-3e5e2a57a0f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:18.544043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7f358-3576-4f93-bd49-3e5e2a57a0f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:18.544346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7f358-3576-4f93-bd49-3e5e2a57a0f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:18.545739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7f358-3576-4f93-bd49-3e5e2a57a0f8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:18.557744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 619/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:23:18.564338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a666f-2f41-4d09-a97d-d0145aaadd62 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:18.641668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:18.662354 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a666f-2f41-4d09-a97d-d0145aaadd62 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:18.698012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c83aa-9646-4b37-9452-087ad254a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:18.698722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c83aa-9646-4b37-9452-087ad254a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:18.699001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c83aa-9646-4b37-9452-087ad254a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:18.699270 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c83aa-9646-4b37-9452-087ad254a8b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:18.706347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c83aa-9646-4b37-9452-087ad254a8b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:18.707783 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c83aa-9646-4b37-9452-087ad254a8b1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-112c83aa-9646-4b37-9452-087ad254a8b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:23:18.720177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:18.721267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:18.722402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:23:18.722402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:23:18.722402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:23:18.722402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:23:18.722402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:23:18.722402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:23:18.722402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:18.722402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:18.722402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 625/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:18.727534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7f358-3576-4f93-bd49-3e5e2a57a0f8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:18.826075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7f358-3576-4f93-bd49-3e5e2a57a0f8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:18.858909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d156094-49d1-4f4c-b7da-6826e92c5354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:18.859517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d156094-49d1-4f4c-b7da-6826e92c5354 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:18.859795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d156094-49d1-4f4c-b7da-6826e92c5354 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:18.860067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d156094-49d1-4f4c-b7da-6826e92c5354 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:18.860968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d156094-49d1-4f4c-b7da-6826e92c5354 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:18.861302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d156094-49d1-4f4c-b7da-6826e92c5354 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:18.862764 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d156094-49d1-4f4c-b7da-6826e92c5354 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:18.874543 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 620/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:18.880645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c83aa-9646-4b37-9452-087ad254a8b1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:18.980645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c83aa-9646-4b37-9452-087ad254a8b1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:19.014193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed8c72-29d3-41b8-8901-31087fe6a3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:19.014910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed8c72-29d3-41b8-8901-31087fe6a3fb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:19.015194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed8c72-29d3-41b8-8901-31087fe6a3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:19.015470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed8c72-29d3-41b8-8901-31087fe6a3fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:19.016254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed8c72-29d3-41b8-8901-31087fe6a3fb None admin] RBAC: Adding query filter params (role.id=32be7893438b4f25a422f68ef7c24fef, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=a5593bc41bce41b4b44616c355976cc9) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:19.017505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed8c72-29d3-41b8-8901-31087fe6a3fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:19.018619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed8c72-29d3-41b8-8901-31087fe6a3fb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:19.024230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 626/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:23:18 2022] GET /identity/v3/role_assignments?user.id=a5593bc41bce41b4b44616c355976cc9&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=32be7893438b4f25a422f68ef7c24fef => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:21.056509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583b22e-97f2-4047-8567-a0e31690125a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:21.057121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583b22e-97f2-4047-8567-a0e31690125a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:21.057121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583b22e-97f2-4047-8567-a0e31690125a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:21.058479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 621/1247] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:21.063730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3df1d-a8a2-4d9c-87d2-1ec42a0073bf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:21.067082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3df1d-a8a2-4d9c-87d2-1ec42a0073bf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:21.067082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3df1d-a8a2-4d9c-87d2-1ec42a0073bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:21.070595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:21.083057 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a4a3df1d-a8a2-4d9c-87d2-1ec42a0073bf None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:21.084234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a4a3df1d-a8a2-4d9c-87d2-1ec42a0073bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:21.150124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 627/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:23:21.173970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583b22e-97f2-4047-8567-a0e31690125a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:21.192659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:21.274850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583b22e-97f2-4047-8567-a0e31690125a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:21.308378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470971d-36b2-4a62-b931-bb84900e4d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:21.308940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470971d-36b2-4a62-b931-bb84900e4d3e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:21.309247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470971d-36b2-4a62-b931-bb84900e4d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:21.309517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470971d-36b2-4a62-b931-bb84900e4d3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:21.319798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470971d-36b2-4a62-b931-bb84900e4d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b470971d-36b2-4a62-b931-bb84900e4d3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:23:21.324608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:21.330197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:21.331381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 622/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:23:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:21.332410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3df1d-a8a2-4d9c-87d2-1ec42a0073bf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:21.431679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3df1d-a8a2-4d9c-87d2-1ec42a0073bf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:21.460040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:21.464855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b0949-ab34-4f68-a7ef-2de797f46ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:21.465499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0949-ab34-4f68-a7ef-2de797f46ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:21.465778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0949-ab34-4f68-a7ef-2de797f46ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:21.466050 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0949-ab34-4f68-a7ef-2de797f46ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:21.466750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b0949-ab34-4f68-a7ef-2de797f46ce9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:21.467200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b0949-ab34-4f68-a7ef-2de797f46ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:21.468589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b0949-ab34-4f68-a7ef-2de797f46ce9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:21.477007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 628/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:23:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:21.482745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470971d-36b2-4a62-b931-bb84900e4d3e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:21.561834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:21.585017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470971d-36b2-4a62-b931-bb84900e4d3e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:21.618859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ac3e-438c-458e-ae61-10d377f81797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:21.619492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ac3e-438c-458e-ae61-10d377f81797 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:21.619772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ac3e-438c-458e-ae61-10d377f81797 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:21.620044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ac3e-438c-458e-ae61-10d377f81797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:21.629901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94ac3e-438c-458e-ae61-10d377f81797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:21.631336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94ac3e-438c-458e-ae61-10d377f81797 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6d94ac3e-438c-458e-ae61-10d377f81797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:21.646343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:21.647492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:21.648628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:21.648628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:21.648628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:21.648628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:21.648628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 623/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:21.653611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b0949-ab34-4f68-a7ef-2de797f46ce9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:21.753087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b0949-ab34-4f68-a7ef-2de797f46ce9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:21.785469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023ee11-40b7-4dfc-83db-ba5500157a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:21.786081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023ee11-40b7-4dfc-83db-ba5500157a24 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:21.786362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023ee11-40b7-4dfc-83db-ba5500157a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:21.786634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023ee11-40b7-4dfc-83db-ba5500157a24 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:21.787318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023ee11-40b7-4dfc-83db-ba5500157a24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:21.787621 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023ee11-40b7-4dfc-83db-ba5500157a24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:21.788997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023ee11-40b7-4dfc-83db-ba5500157a24 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:21.801447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 629/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:21.807483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ac3e-438c-458e-ae61-10d377f81797 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:21.908753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ac3e-438c-458e-ae61-10d377f81797 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:21.934427 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:21.942750 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f689ed-062f-4568-9a11-205d80704fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:21.943376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f689ed-062f-4568-9a11-205d80704fde None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:21.943650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f689ed-062f-4568-9a11-205d80704fde None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:21.943918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f689ed-062f-4568-9a11-205d80704fde None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:21.951998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f689ed-062f-4568-9a11-205d80704fde None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:21.953461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f689ed-062f-4568-9a11-205d80704fde None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-58f689ed-062f-4568-9a11-205d80704fde None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:23:21.965166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:21.968196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:21.969546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:21.969546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:21.969546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:23:21.969546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:23:21.969546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:23:21.969546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:23:21.969546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:23:21.969546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:23:21.969546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:21.969546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:21.969546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 624/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:21.972716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023ee11-40b7-4dfc-83db-ba5500157a24 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:22.028211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:22.073037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023ee11-40b7-4dfc-83db-ba5500157a24 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:22.110360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1997b-a731-4f6c-a8e8-969612c1d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:22.110979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1997b-a731-4f6c-a8e8-969612c1d694 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:22.111250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1997b-a731-4f6c-a8e8-969612c1d694 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:22.111519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1997b-a731-4f6c-a8e8-969612c1d694 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:22.112302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1997b-a731-4f6c-a8e8-969612c1d694 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:22.112604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1997b-a731-4f6c-a8e8-969612c1d694 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:22.114178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1997b-a731-4f6c-a8e8-969612c1d694 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:22.132256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 630/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 05:23:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:22.138263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f689ed-062f-4568-9a11-205d80704fde None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:22.239549 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f689ed-062f-4568-9a11-205d80704fde None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:22.274471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7280ad-df4e-44a3-baaa-5d6c2a6dfc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:22.275069 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7280ad-df4e-44a3-baaa-5d6c2a6dfc60 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:22.275346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7280ad-df4e-44a3-baaa-5d6c2a6dfc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:22.275611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7280ad-df4e-44a3-baaa-5d6c2a6dfc60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:22.331449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:22.343518 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7280ad-df4e-44a3-baaa-5d6c2a6dfc60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:22.345576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7280ad-df4e-44a3-baaa-5d6c2a6dfc60 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:22.445552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 625/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:23:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:23:22.451343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1997b-a731-4f6c-a8e8-969612c1d694 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:22.550287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1997b-a731-4f6c-a8e8-969612c1d694 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:22.563742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:22.584953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a05e7-0a10-4e00-9ed9-a1e394fdf7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:22.585620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a05e7-0a10-4e00-9ed9-a1e394fdf7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:22.585899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a05e7-0a10-4e00-9ed9-a1e394fdf7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:22.586169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a05e7-0a10-4e00-9ed9-a1e394fdf7f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:22.595963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a05e7-0a10-4e00-9ed9-a1e394fdf7f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:22.597447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a05e7-0a10-4e00-9ed9-a1e394fdf7f0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ad8a05e7-0a10-4e00-9ed9-a1e394fdf7f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:22.612268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:22.613364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:22.614495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:22.614495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:22.614495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:22.614495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:22.614495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 631/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:23:22.619180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7280ad-df4e-44a3-baaa-5d6c2a6dfc60 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:22.706568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:22.724164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7280ad-df4e-44a3-baaa-5d6c2a6dfc60 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:22.763398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8858e-7128-4f5e-9314-a22c13ad553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:22.764009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8858e-7128-4f5e-9314-a22c13ad553d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:22.764290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8858e-7128-4f5e-9314-a22c13ad553d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:22.764563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8858e-7128-4f5e-9314-a22c13ad553d None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:22.765279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8858e-7128-4f5e-9314-a22c13ad553d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:22.765579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8858e-7128-4f5e-9314-a22c13ad553d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:22.766995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8858e-7128-4f5e-9314-a22c13ad553d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:22.778405 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 626/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:22.784723 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a05e7-0a10-4e00-9ed9-a1e394fdf7f0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:22.884655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a05e7-0a10-4e00-9ed9-a1e394fdf7f0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:22.918241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c069b5-af09-4fd8-a150-380badd54bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:22.918878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c069b5-af09-4fd8-a150-380badd54bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:22.919160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c069b5-af09-4fd8-a150-380badd54bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:22.919434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c069b5-af09-4fd8-a150-380badd54bc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:22.926143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c069b5-af09-4fd8-a150-380badd54bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:22.927581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c069b5-af09-4fd8-a150-380badd54bc8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f9c069b5-af09-4fd8-a150-380badd54bc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:23:22.939479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:22.940579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:22.946051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:23:22.946051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:23:22.946051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:23:22.946051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:23:22.946051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:23:22.946051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:23:22.946051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:22.946051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:22.946051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 632/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:23:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:22.946702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8858e-7128-4f5e-9314-a22c13ad553d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:23.046933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8858e-7128-4f5e-9314-a22c13ad553d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:23.081538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a175664-fb94-4b66-978f-18958192cb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:23.082138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175664-fb94-4b66-978f-18958192cb65 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:23.082769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175664-fb94-4b66-978f-18958192cb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:23.082769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175664-fb94-4b66-978f-18958192cb65 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:23.083391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a175664-fb94-4b66-978f-18958192cb65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:23.088067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a175664-fb94-4b66-978f-18958192cb65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:23.089534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a175664-fb94-4b66-978f-18958192cb65 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:23.102400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 627/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:23.108960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c069b5-af09-4fd8-a150-380badd54bc8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:23.137982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:23.213201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c069b5-af09-4fd8-a150-380badd54bc8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:23.246876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234ad80-0146-4a13-8c5b-5d8641e21d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:23.247488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ad80-0146-4a13-8c5b-5d8641e21d9a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:23.247772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ad80-0146-4a13-8c5b-5d8641e21d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:23.248049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234ad80-0146-4a13-8c5b-5d8641e21d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:23.248825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234ad80-0146-4a13-8c5b-5d8641e21d9a None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=a5593bc41bce41b4b44616c355976cc9) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:23.249161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234ad80-0146-4a13-8c5b-5d8641e21d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:23.253565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234ad80-0146-4a13-8c5b-5d8641e21d9a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:23.256019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 633/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:23:23 2022] GET /identity/v3/role_assignments?user.id=a5593bc41bce41b4b44616c355976cc9&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=57a86ff4c9de433399662eebf6893065 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:23:25.247779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e4fbd-d29c-4f47-91ee-565a31607ffd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:25.248289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e4fbd-d29c-4f47-91ee-565a31607ffd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:25.248289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e4fbd-d29c-4f47-91ee-565a31607ffd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:25.249695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 628/1261] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:25.255365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddf40-0048-495a-b859-de20445875e1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:25.255805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddf40-0048-495a-b859-de20445875e1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:25.255945 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddf40-0048-495a-b859-de20445875e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:25.274391 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-778ddf40-0048-495a-b859-de20445875e1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:25.275569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-778ddf40-0048-495a-b859-de20445875e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:25.340117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 634/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:23:25.363010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e4fbd-d29c-4f47-91ee-565a31607ffd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:25.373746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:25.465218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e4fbd-d29c-4f47-91ee-565a31607ffd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:25.502042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da72c7d-3ca8-4d8f-8d6a-1400e58ea328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:25.502715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72c7d-3ca8-4d8f-8d6a-1400e58ea328 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:25.502995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72c7d-3ca8-4d8f-8d6a-1400e58ea328 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:25.503270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72c7d-3ca8-4d8f-8d6a-1400e58ea328 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:25.512992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da72c7d-3ca8-4d8f-8d6a-1400e58ea328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7da72c7d-3ca8-4d8f-8d6a-1400e58ea328 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:23:25.518659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:25.519692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:25.520577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 629/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:23:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:25.526045 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ddf40-0048-495a-b859-de20445875e1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:25.545121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:25.628530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ddf40-0048-495a-b859-de20445875e1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:25.662304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a34bf-3ade-4aab-8805-3ab04bc44054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:25.662924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a34bf-3ade-4aab-8805-3ab04bc44054 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:25.663202 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a34bf-3ade-4aab-8805-3ab04bc44054 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:25.663468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a34bf-3ade-4aab-8805-3ab04bc44054 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:25.664169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a34bf-3ade-4aab-8805-3ab04bc44054 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:25.664468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a34bf-3ade-4aab-8805-3ab04bc44054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:25.665868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a34bf-3ade-4aab-8805-3ab04bc44054 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:25.674656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 635/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:25.680491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da72c7d-3ca8-4d8f-8d6a-1400e58ea328 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:25.745889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:25.779106 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da72c7d-3ca8-4d8f-8d6a-1400e58ea328 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:25.814506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816300-84bf-423e-bd37-0df937aad9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:25.815134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816300-84bf-423e-bd37-0df937aad9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:25.815411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816300-84bf-423e-bd37-0df937aad9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:25.815679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816300-84bf-423e-bd37-0df937aad9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:25.825867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf816300-84bf-423e-bd37-0df937aad9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:25.827309 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf816300-84bf-423e-bd37-0df937aad9a1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-bf816300-84bf-423e-bd37-0df937aad9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:25.840878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:25.846829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:25.848020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:25.848020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:25.848020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:25.848020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:25.848020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 630/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:25.848796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a34bf-3ade-4aab-8805-3ab04bc44054 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:25.930078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:25.948808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a34bf-3ade-4aab-8805-3ab04bc44054 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:25.983433 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577def5-dd7e-424e-8355-c9a816f48035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:25.984080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577def5-dd7e-424e-8355-c9a816f48035 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:25.984362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577def5-dd7e-424e-8355-c9a816f48035 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:25.984652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577def5-dd7e-424e-8355-c9a816f48035 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:25.985922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577def5-dd7e-424e-8355-c9a816f48035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:25.986225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577def5-dd7e-424e-8355-c9a816f48035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:25.987594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577def5-dd7e-424e-8355-c9a816f48035 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:26.003199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 636/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:26.006692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816300-84bf-423e-bd37-0df937aad9a1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:26.108445 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816300-84bf-423e-bd37-0df937aad9a1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:26.129097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:26.143008 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efb64a-b951-4a90-8908-5441248f22e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:26.143646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efb64a-b951-4a90-8908-5441248f22e2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:26.143926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efb64a-b951-4a90-8908-5441248f22e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:26.144198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efb64a-b951-4a90-8908-5441248f22e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:26.151563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efb64a-b951-4a90-8908-5441248f22e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:26.153044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efb64a-b951-4a90-8908-5441248f22e2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a2efb64a-b951-4a90-8908-5441248f22e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:23:26.164997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:26.166514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:26.167655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:26.167655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:26.167655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:23:26.167655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:23:26.167655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:23:26.167655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:23:26.167655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:23:26.167655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:23:26.167655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:26.167655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:26.167655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 631/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:26.172754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577def5-dd7e-424e-8355-c9a816f48035 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:26.272591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577def5-dd7e-424e-8355-c9a816f48035 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:26.305782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb32e8-1573-4c27-b27d-f8a769ee4b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:26.306385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb32e8-1573-4c27-b27d-f8a769ee4b9c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:26.306657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb32e8-1573-4c27-b27d-f8a769ee4b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:26.306923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb32e8-1573-4c27-b27d-f8a769ee4b9c None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:26.307733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb32e8-1573-4c27-b27d-f8a769ee4b9c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:26.308034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb32e8-1573-4c27-b27d-f8a769ee4b9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:26.309470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb32e8-1573-4c27-b27d-f8a769ee4b9c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:26.319141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:26.327016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 637/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 05:23:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:26.332894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efb64a-b951-4a90-8908-5441248f22e2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:26.433617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efb64a-b951-4a90-8908-5441248f22e2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:26.466168 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b03b2-7ce3-4e68-8505-6190d41edaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:26.466795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b03b2-7ce3-4e68-8505-6190d41edaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:26.467078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b03b2-7ce3-4e68-8505-6190d41edaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:26.467348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b03b2-7ce3-4e68-8505-6190d41edaa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:26.478655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b03b2-7ce3-4e68-8505-6190d41edaa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:26.480192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b03b2-7ce3-4e68-8505-6190d41edaa4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a35b03b2-7ce3-4e68-8505-6190d41edaa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:26.495132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:26.496214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:26.497560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:26.497560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:26.497560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:26.497560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:26.497560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 632/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:26.502157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb32e8-1573-4c27-b27d-f8a769ee4b9c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:26.603494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb32e8-1573-4c27-b27d-f8a769ee4b9c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:26.637276 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab780f-3a0e-4ed8-9d71-415f08222af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:26.637892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab780f-3a0e-4ed8-9d71-415f08222af8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:26.638172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab780f-3a0e-4ed8-9d71-415f08222af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:26.638444 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab780f-3a0e-4ed8-9d71-415f08222af8 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:26.639121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab780f-3a0e-4ed8-9d71-415f08222af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:26.639420 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab780f-3a0e-4ed8-9d71-415f08222af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:26.640824 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab780f-3a0e-4ed8-9d71-415f08222af8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:26.652419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 638/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:26.658734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b03b2-7ce3-4e68-8505-6190d41edaa4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:26.690953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:26.759926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b03b2-7ce3-4e68-8505-6190d41edaa4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:26.794536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf0a36-73a8-4bf6-81f2-0fd2f53f70a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:26.795165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0a36-73a8-4bf6-81f2-0fd2f53f70a9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:26.795442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0a36-73a8-4bf6-81f2-0fd2f53f70a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:26.795707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0a36-73a8-4bf6-81f2-0fd2f53f70a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:26.803044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf0a36-73a8-4bf6-81f2-0fd2f53f70a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:26.804543 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf0a36-73a8-4bf6-81f2-0fd2f53f70a9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-dcdf0a36-73a8-4bf6-81f2-0fd2f53f70a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:23:26.817060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:26.818172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:26.819291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:23:26.819291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:23:26.819291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:23:26.819291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:23:26.819291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:23:26.819291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:23:26.819291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:26.819291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:26.819291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 633/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:26.824332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab780f-3a0e-4ed8-9d71-415f08222af8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:26.882344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:26.921515 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab780f-3a0e-4ed8-9d71-415f08222af8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:26.956765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bacca2-2dbd-4aad-b998-9936ed919351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:26.957410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bacca2-2dbd-4aad-b998-9936ed919351 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:26.957694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bacca2-2dbd-4aad-b998-9936ed919351 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:26.957968 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bacca2-2dbd-4aad-b998-9936ed919351 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:26.958713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bacca2-2dbd-4aad-b998-9936ed919351 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:26.959017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bacca2-2dbd-4aad-b998-9936ed919351 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:26.960450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bacca2-2dbd-4aad-b998-9936ed919351 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:26.973040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 639/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:23:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:26.979045 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf0a36-73a8-4bf6-81f2-0fd2f53f70a9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:27.069241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:27.077712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf0a36-73a8-4bf6-81f2-0fd2f53f70a9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:27.110462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c95b0c-a59d-4818-a0e1-ffe52e6de91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:27.111192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c95b0c-a59d-4818-a0e1-ffe52e6de91f None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:27.111471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c95b0c-a59d-4818-a0e1-ffe52e6de91f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:27.111743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c95b0c-a59d-4818-a0e1-ffe52e6de91f None admin] PATH_INFO: `/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/a5593bc41bce41b4b44616c355976cc9/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:27.113833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c95b0c-a59d-4818-a0e1-ffe52e6de91f None admin] RBAC: Authorizing `identity:create_grant(project_id=a74afe28b3b44b5eb0db99056b652ce6, user_id=a5593bc41bce41b4b44616c355976cc9, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:27.115265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c95b0c-a59d-4818-a0e1-ffe52e6de91f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:27.201845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 634/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 05:23:26 2022] PUT /identity/v3/projects/a74afe28b3b44b5eb0db99056b652ce6/users/a5593bc41bce41b4b44616c355976cc9/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:23:29.187867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8d956-ac88-4b54-9c29-feafc7c09920 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:29.192248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8d956-ac88-4b54-9c29-feafc7c09920 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:29.192248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8d956-ac88-4b54-9c29-feafc7c09920 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:29.192248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 640/1274] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:29.195063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacbd47-68db-4205-844b-2df26c9efb26 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:29.195494 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacbd47-68db-4205-844b-2df26c9efb26 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:29.195613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacbd47-68db-4205-844b-2df26c9efb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:29.213974 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9dacbd47-68db-4205-844b-2df26c9efb26 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:29.215146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9dacbd47-68db-4205-844b-2df26c9efb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:29.279729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 635/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:23:29.303253 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8d956-ac88-4b54-9c29-feafc7c09920 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:29.403592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8d956-ac88-4b54-9c29-feafc7c09920 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:29.421315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:29.437546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5089a-845a-40bf-8b16-d150574e83f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:29.438873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5089a-845a-40bf-8b16-d150574e83f4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:29.439243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5089a-845a-40bf-8b16-d150574e83f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:29.439516 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5089a-845a-40bf-8b16-d150574e83f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:29.449245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5089a-845a-40bf-8b16-d150574e83f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-99f5089a-845a-40bf-8b16-d150574e83f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 05:23:29.456049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:29.457217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:29.458266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 641/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 05:23:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:29.462848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacbd47-68db-4205-844b-2df26c9efb26 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:29.540568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:29.558465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacbd47-68db-4205-844b-2df26c9efb26 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:29.592064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da5e2e-3957-4bc9-b365-a360afbc5068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:29.592672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da5e2e-3957-4bc9-b365-a360afbc5068 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:29.592945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da5e2e-3957-4bc9-b365-a360afbc5068 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:29.593242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da5e2e-3957-4bc9-b365-a360afbc5068 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:29.593950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da5e2e-3957-4bc9-b365-a360afbc5068 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:29.594253 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da5e2e-3957-4bc9-b365-a360afbc5068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:29.595612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da5e2e-3957-4bc9-b365-a360afbc5068 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:29.603843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 636/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 05:23:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:29.610031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5089a-845a-40bf-8b16-d150574e83f4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:29.710440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5089a-845a-40bf-8b16-d150574e83f4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:29.744804 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48072b15-6e7a-400f-9b4d-c772a686059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:29.745536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48072b15-6e7a-400f-9b4d-c772a686059b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:29.745816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48072b15-6e7a-400f-9b4d-c772a686059b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:29.746086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48072b15-6e7a-400f-9b4d-c772a686059b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:29.756342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48072b15-6e7a-400f-9b4d-c772a686059b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:29.757816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48072b15-6e7a-400f-9b4d-c772a686059b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-48072b15-6e7a-400f-9b4d-c772a686059b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:29.772788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:29.773929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:29.775087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:29.775087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:29.775087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:29.775087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:29.775087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 642/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:29.781491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da5e2e-3957-4bc9-b365-a360afbc5068 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:29.882451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da5e2e-3957-4bc9-b365-a360afbc5068 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:29.916218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283c679-c40f-4935-9f8f-2246d6e25b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:29.916826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283c679-c40f-4935-9f8f-2246d6e25b8c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:29.917242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283c679-c40f-4935-9f8f-2246d6e25b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:29.917520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283c679-c40f-4935-9f8f-2246d6e25b8c None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:29.918205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283c679-c40f-4935-9f8f-2246d6e25b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:29.918507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283c679-c40f-4935-9f8f-2246d6e25b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:29.919925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283c679-c40f-4935-9f8f-2246d6e25b8c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:29.931430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 637/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:29.937166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48072b15-6e7a-400f-9b4d-c772a686059b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:29.967579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:30.036325 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48072b15-6e7a-400f-9b4d-c772a686059b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:30.069472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce7de8-9744-4c8e-88b0-db6ec58cace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:30.070097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce7de8-9744-4c8e-88b0-db6ec58cace3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:30.070373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce7de8-9744-4c8e-88b0-db6ec58cace3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:30.070643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce7de8-9744-4c8e-88b0-db6ec58cace3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:30.077586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce7de8-9744-4c8e-88b0-db6ec58cace3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:30.081015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce7de8-9744-4c8e-88b0-db6ec58cace3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f2ce7de8-9744-4c8e-88b0-db6ec58cace3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 05:23:30.092223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:30.095611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:30.096907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:30.096907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:30.096907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 05:23:30.096907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 05:23:30.096907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 05:23:30.096907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 05:23:30.096907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 05:23:30.096907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 05:23:30.096907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 05:23:30.096907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:30.096907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 643/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:30.100733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283c679-c40f-4935-9f8f-2246d6e25b8c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:30.103879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:30.195942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283c679-c40f-4935-9f8f-2246d6e25b8c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:30.231471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45c3c4-afe7-423e-b1ed-97d4cb773d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:30.232012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45c3c4-afe7-423e-b1ed-97d4cb773d76 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:30.232297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45c3c4-afe7-423e-b1ed-97d4cb773d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:30.232571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45c3c4-afe7-423e-b1ed-97d4cb773d76 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:30.233391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45c3c4-afe7-423e-b1ed-97d4cb773d76 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:30.233700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45c3c4-afe7-423e-b1ed-97d4cb773d76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:30.235143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45c3c4-afe7-423e-b1ed-97d4cb773d76 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:30.253195 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 638/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 05:23:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:30.258944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce7de8-9744-4c8e-88b0-db6ec58cace3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:30.349770 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:30.359254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce7de8-9744-4c8e-88b0-db6ec58cace3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:30.393405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce6684-259f-4975-9d74-d5f5a96c82b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:30.394035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce6684-259f-4975-9d74-d5f5a96c82b5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:30.394316 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce6684-259f-4975-9d74-d5f5a96c82b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:30.394587 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce6684-259f-4975-9d74-d5f5a96c82b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:30.462441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce6684-259f-4975-9d74-d5f5a96c82b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:30.463917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce6684-259f-4975-9d74-d5f5a96c82b5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:30.550429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:30.560356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 644/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 05:23:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 05:23:30.566767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45c3c4-afe7-423e-b1ed-97d4cb773d76 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:30.627161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:30.664156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45c3c4-afe7-423e-b1ed-97d4cb773d76 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:30.697902 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46689d-b933-4d57-83f8-e332f148ca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:30.698535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46689d-b933-4d57-83f8-e332f148ca61 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:30.698814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46689d-b933-4d57-83f8-e332f148ca61 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:30.699086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46689d-b933-4d57-83f8-e332f148ca61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:30.709159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46689d-b933-4d57-83f8-e332f148ca61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:30.710648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46689d-b933-4d57-83f8-e332f148ca61 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0d46689d-b933-4d57-83f8-e332f148ca61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 05:23:30.724878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:30.725851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:30.726803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 05:23:30.726803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 05:23:30.726803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 05:23:30.726803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:30.726803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 639/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:30.731797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce6684-259f-4975-9d74-d5f5a96c82b5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:30.835837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce6684-259f-4975-9d74-d5f5a96c82b5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:30.868794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f4741-f5a9-4cb2-81b2-67cf6a0a61dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:30.869409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4741-f5a9-4cb2-81b2-67cf6a0a61dd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:30.869687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4741-f5a9-4cb2-81b2-67cf6a0a61dd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:30.869955 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4741-f5a9-4cb2-81b2-67cf6a0a61dd None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:30.870633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f4741-f5a9-4cb2-81b2-67cf6a0a61dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:30.870939 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f4741-f5a9-4cb2-81b2-67cf6a0a61dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:30.872288 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f4741-f5a9-4cb2-81b2-67cf6a0a61dd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:30.884292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 645/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 05:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:30.890253 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46689d-b933-4d57-83f8-e332f148ca61 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:30.989862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46689d-b933-4d57-83f8-e332f148ca61 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:31.003005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:31.022044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc453a5-7a88-4820-9ff7-289335b5e451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:31.022667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc453a5-7a88-4820-9ff7-289335b5e451 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:31.022939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc453a5-7a88-4820-9ff7-289335b5e451 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:31.023203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc453a5-7a88-4820-9ff7-289335b5e451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:31.029593 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc453a5-7a88-4820-9ff7-289335b5e451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:31.031025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc453a5-7a88-4820-9ff7-289335b5e451 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4dc453a5-7a88-4820-9ff7-289335b5e451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 05:23:31.042696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:31.043774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:31.044868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 05:23:31.044868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 05:23:31.044868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 05:23:31.044868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 05:23:31.044868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 05:23:31.044868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 05:23:31.044868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 05:23:31.044868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 28 05:23:31.044868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 640/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 05:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:31.050635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f4741-f5a9-4cb2-81b2-67cf6a0a61dd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:31.099990 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:31.148800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f4741-f5a9-4cb2-81b2-67cf6a0a61dd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:31.184613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e855ae0-2c49-4b9d-b4e2-34ec84194fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:31.185269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e855ae0-2c49-4b9d-b4e2-34ec84194fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:31.185588 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e855ae0-2c49-4b9d-b4e2-34ec84194fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:31.185864 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e855ae0-2c49-4b9d-b4e2-34ec84194fc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:31.186615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e855ae0-2c49-4b9d-b4e2-34ec84194fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:31.186956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e855ae0-2c49-4b9d-b4e2-34ec84194fc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:31.188423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e855ae0-2c49-4b9d-b4e2-34ec84194fc8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:31.200656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 646/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 05:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:31.207142 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc453a5-7a88-4820-9ff7-289335b5e451 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:31.308197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc453a5-7a88-4820-9ff7-289335b5e451 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:31.341511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff40c8-ce73-4063-9a45-c23a9c8eeff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:31.342141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff40c8-ce73-4063-9a45-c23a9c8eeff5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:31.342423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff40c8-ce73-4063-9a45-c23a9c8eeff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:31.342696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff40c8-ce73-4063-9a45-c23a9c8eeff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:31.343480 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff40c8-ce73-4063-9a45-c23a9c8eeff5 None admin] RBAC: Adding query filter params (role.id=57a86ff4c9de433399662eebf6893065, scope.project.id=a74afe28b3b44b5eb0db99056b652ce6, user.id=a5593bc41bce41b4b44616c355976cc9) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:31.343793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff40c8-ce73-4063-9a45-c23a9c8eeff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:31.345953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff40c8-ce73-4063-9a45-c23a9c8eeff5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:31.352675 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 641/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 05:23:31 2022] GET /identity/v3/role_assignments?user.id=a5593bc41bce41b4b44616c355976cc9&scope.project.id=a74afe28b3b44b5eb0db99056b652ce6&role.id=57a86ff4c9de433399662eebf6893065 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:33.445584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1017b12-c27e-4333-8766-b517b1bb6aeb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:33.446084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1017b12-c27e-4333-8766-b517b1bb6aeb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:33.446084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1017b12-c27e-4333-8766-b517b1bb6aeb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:33.447363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 647/1288] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:33.452488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5136fc-d6f4-4020-a175-f4bfc1202981 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:33.452908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5136fc-d6f4-4020-a175-f4bfc1202981 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:33.453031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5136fc-d6f4-4020-a175-f4bfc1202981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:33.471643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3f5136fc-d6f4-4020-a175-f4bfc1202981 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:33.472803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3f5136fc-d6f4-4020-a175-f4bfc1202981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:33.501898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:33.538378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 642/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 05:23:33.561636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1017b12-c27e-4333-8766-b517b1bb6aeb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:33.662011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1017b12-c27e-4333-8766-b517b1bb6aeb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:33.673463 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:33.697614 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b50534-22d3-4bc5-8977-ffecf67979f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:33.698183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b50534-22d3-4bc5-8977-ffecf67979f8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:33.698458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b50534-22d3-4bc5-8977-ffecf67979f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:33.698725 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b50534-22d3-4bc5-8977-ffecf67979f8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:33.699338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b50534-22d3-4bc5-8977-ffecf67979f8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:33.700701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b50534-22d3-4bc5-8977-ffecf67979f8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-84b50534-22d3-4bc5-8977-ffecf67979f8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:33.709407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:33.710675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:33.711721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 648/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 05:23:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:23:33.716561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5136fc-d6f4-4020-a175-f4bfc1202981 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:33.815154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5136fc-d6f4-4020-a175-f4bfc1202981 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:33.847929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f04dc-9aeb-4fe4-8fe5-864c3a122cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:33.848533 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f04dc-9aeb-4fe4-8fe5-864c3a122cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:33.848808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f04dc-9aeb-4fe4-8fe5-864c3a122cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:33.849073 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f04dc-9aeb-4fe4-8fe5-864c3a122cb4 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:33.849823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f04dc-9aeb-4fe4-8fe5-864c3a122cb4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:33.850101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f04dc-9aeb-4fe4-8fe5-864c3a122cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:33.851522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f04dc-9aeb-4fe4-8fe5-864c3a122cb4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:33.856331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 643/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 05:23:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:33.862706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b50534-22d3-4bc5-8977-ffecf67979f8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:33.963331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b50534-22d3-4bc5-8977-ffecf67979f8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:33.996417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4cd19-6448-42bb-b441-5ff102fa72ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:33.997015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4cd19-6448-42bb-b441-5ff102fa72ee None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:33.997320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4cd19-6448-42bb-b441-5ff102fa72ee None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:33.997586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4cd19-6448-42bb-b441-5ff102fa72ee None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:33.998243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4cd19-6448-42bb-b441-5ff102fa72ee None admin] RBAC: Adding query filter params (type=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:33.998544 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4cd19-6448-42bb-b441-5ff102fa72ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:33.999889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4cd19-6448-42bb-b441-5ff102fa72ee None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:34.004352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 649/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 05:23:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:35.977119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab9a07-6798-4eed-b5e8-aac2e6722ed6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:35.977676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab9a07-6798-4eed-b5e8-aac2e6722ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:35.977676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab9a07-6798-4eed-b5e8-aac2e6722ed6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:35.979037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 644/1293] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:35.984062 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dc4f8-a0f8-419b-8c55-5b9066f99cac None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:35.984942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dc4f8-a0f8-419b-8c55-5b9066f99cac None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:35.985409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dc4f8-a0f8-419b-8c55-5b9066f99cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:36.003686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1a9dc4f8-a0f8-419b-8c55-5b9066f99cac None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:36.004860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1a9dc4f8-a0f8-419b-8c55-5b9066f99cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:36.033760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:36.070326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 650/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:23:36.091788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab9a07-6798-4eed-b5e8-aac2e6722ed6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:36.122318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:36.192586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab9a07-6798-4eed-b5e8-aac2e6722ed6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:36.225763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295bd28-46fd-4ad5-893e-b9d0e31f3051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:36.226365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bd28-46fd-4ad5-893e-b9d0e31f3051 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:36.226639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bd28-46fd-4ad5-893e-b9d0e31f3051 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:36.226907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295bd28-46fd-4ad5-893e-b9d0e31f3051 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:36.227637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295bd28-46fd-4ad5-893e-b9d0e31f3051 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:36.228931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295bd28-46fd-4ad5-893e-b9d0e31f3051 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:36.313773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 645/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 05:23:36 2022] POST /identity/v3/services => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:23:38.417552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06689fe5-2c2c-4ac5-a7a0-db78ebb4cc34 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:38.418054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06689fe5-2c2c-4ac5-a7a0-db78ebb4cc34 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:38.418054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06689fe5-2c2c-4ac5-a7a0-db78ebb4cc34 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:38.419375 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 651/1296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:38.425581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9040b-babb-48e6-a338-d2d673057e16 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:38.425999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9040b-babb-48e6-a338-d2d673057e16 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:38.426092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9040b-babb-48e6-a338-d2d673057e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:38.443741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-65b9040b-babb-48e6-a338-d2d673057e16 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:38.444992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-65b9040b-babb-48e6-a338-d2d673057e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:38.515528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 646/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:23:38.538422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06689fe5-2c2c-4ac5-a7a0-db78ebb4cc34 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:38.640277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06689fe5-2c2c-4ac5-a7a0-db78ebb4cc34 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:38.675285 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dd0bc-e9c6-44a9-9853-55b5e26cfbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:38.675853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dd0bc-e9c6-44a9-9853-55b5e26cfbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:38.676135 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dd0bc-e9c6-44a9-9853-55b5e26cfbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:38.676408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dd0bc-e9c6-44a9-9853-55b5e26cfbf8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:38.677025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dd0bc-e9c6-44a9-9853-55b5e26cfbf8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:38.678431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dd0bc-e9c6-44a9-9853-55b5e26cfbf8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f99dd0bc-e9c6-44a9-9853-55b5e26cfbf8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:38.687439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:38.688626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:38.689914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 652/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 05:23:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 05:23:38.694864 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9040b-babb-48e6-a338-d2d673057e16 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:38.713221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:38.797598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9040b-babb-48e6-a338-d2d673057e16 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:38.831955 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9fa50-1788-4dc8-b2c0-77e17f629fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:38.832571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9fa50-1788-4dc8-b2c0-77e17f629fac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:38.832966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9fa50-1788-4dc8-b2c0-77e17f629fac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:38.833276 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9fa50-1788-4dc8-b2c0-77e17f629fac None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:38.833954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9fa50-1788-4dc8-b2c0-77e17f629fac None admin] RBAC: Adding query filter params (name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:38.834259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9fa50-1788-4dc8-b2c0-77e17f629fac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:38.835633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9fa50-1788-4dc8-b2c0-77e17f629fac None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:38.840842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 647/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 05:23:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:38.846922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dd0bc-e9c6-44a9-9853-55b5e26cfbf8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:38.878838 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:38.946608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dd0bc-e9c6-44a9-9853-55b5e26cfbf8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:38.979680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ea76a-173c-4e0e-bc58-e50991d1e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:38.980284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ea76a-173c-4e0e-bc58-e50991d1e32a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:38.980559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ea76a-173c-4e0e-bc58-e50991d1e32a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:38.980827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ea76a-173c-4e0e-bc58-e50991d1e32a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:38.981605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ea76a-173c-4e0e-bc58-e50991d1e32a None admin] RBAC: Adding query filter params (interface=public, service_id=6052c6c336164aa6a8b6e9c51384b3f6, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:38.981928 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ea76a-173c-4e0e-bc58-e50991d1e32a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:38.983271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ea76a-173c-4e0e-bc58-e50991d1e32a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:38.988835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 653/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 05:23:38 2022] GET /identity/v3/endpoints?service_id=6052c6c336164aa6a8b6e9c51384b3f6&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:38.994551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9fa50-1788-4dc8-b2c0-77e17f629fac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:39.075208 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:39.092770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9fa50-1788-4dc8-b2c0-77e17f629fac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:39.125983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de65785-0dbf-4b7f-85c2-7370aa06594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:39.126591 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65785-0dbf-4b7f-85c2-7370aa06594e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:39.126869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65785-0dbf-4b7f-85c2-7370aa06594e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:39.127139 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65785-0dbf-4b7f-85c2-7370aa06594e None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:39.127784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de65785-0dbf-4b7f-85c2-7370aa06594e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:39.129227 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de65785-0dbf-4b7f-85c2-7370aa06594e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:39.136240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 648/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 05:23:38 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:23:41.126484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fef846-3c80-4ca0-ac74-52db4141db22 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:41.127017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fef846-3c80-4ca0-ac74-52db4141db22 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:41.127140 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fef846-3c80-4ca0-ac74-52db4141db22 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:41.128416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 654/1302] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:23:41.133487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb32f57-8336-419a-bcfc-349d3beb2bcf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:41.133865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb32f57-8336-419a-bcfc-349d3beb2bcf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:41.134033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb32f57-8336-419a-bcfc-349d3beb2bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:41.152352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-feb32f57-8336-419a-bcfc-349d3beb2bcf None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:23:41.153557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-feb32f57-8336-419a-bcfc-349d3beb2bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:23:41.220469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 649/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:23:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 05:23:41.243199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fef846-3c80-4ca0-ac74-52db4141db22 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:41.337000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:41.344078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fef846-3c80-4ca0-ac74-52db4141db22 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:41.376831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253002d-0afa-46ef-9e6e-bb1df8664ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:41.377426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253002d-0afa-46ef-9e6e-bb1df8664ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:41.377706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253002d-0afa-46ef-9e6e-bb1df8664ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:41.377977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253002d-0afa-46ef-9e6e-bb1df8664ba3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:41.378590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253002d-0afa-46ef-9e6e-bb1df8664ba3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:41.379943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253002d-0afa-46ef-9e6e-bb1df8664ba3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8253002d-0afa-46ef-9e6e-bb1df8664ba3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 05:23:41.389162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 05:23:41.390941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 28 05:23:41.392017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 655/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 05:23:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 05:23:41.397938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb32f57-8336-419a-bcfc-349d3beb2bcf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:41.477773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:41.500412 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb32f57-8336-419a-bcfc-349d3beb2bcf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:41.534446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba3caf-3223-4434-9778-81be3fe2afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:41.535052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba3caf-3223-4434-9778-81be3fe2afbe None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:41.535327 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba3caf-3223-4434-9778-81be3fe2afbe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:41.535646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba3caf-3223-4434-9778-81be3fe2afbe None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:41.536429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba3caf-3223-4434-9778-81be3fe2afbe None admin] RBAC: Adding query filter params (name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:23:41.536729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba3caf-3223-4434-9778-81be3fe2afbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:41.538127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba3caf-3223-4434-9778-81be3fe2afbe None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:41.543384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 650/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 05:23:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:23:41.549439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253002d-0afa-46ef-9e6e-bb1df8664ba3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:23:41.647814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253002d-0afa-46ef-9e6e-bb1df8664ba3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:23:41.680289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e303e9d-3f20-4392-9491-1787657253e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:23:41.680895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e303e9d-3f20-4392-9491-1787657253e7 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:23:41.681198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e303e9d-3f20-4392-9491-1787657253e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:23:41.681467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e303e9d-3f20-4392-9491-1787657253e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:23:41.682165 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e303e9d-3f20-4392-9491-1787657253e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:23:41.683534 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e303e9d-3f20-4392-9491-1787657253e7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:23:41.776938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 656/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:23:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:23:51.554331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=30 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:23:51.772488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:28.985915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04560d8f-f2fb-4aa9-bae4-00798cc6dedc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:28.994407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04560d8f-f2fb-4aa9-bae4-00798cc6dedc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:28.994407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04560d8f-f2fb-4aa9-bae4-00798cc6dedc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:28.995582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d284d-1457-4bb6-8896-358506fb749c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:28.995582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d284d-1457-4bb6-8896-358506fb749c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:28.995582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d284d-1457-4bb6-8896-358506fb749c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:28.998826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 651/1307] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:29:28 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:29.094496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-855d284d-1457-4bb6-8896-358506fb749c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:29.095700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-855d284d-1457-4bb6-8896-358506fb749c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:29.225517 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 657/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:29:29.262850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04040c4c-9ed9-45cd-85c6-9d48c86e6210 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:29.262850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04040c4c-9ed9-45cd-85c6-9d48c86e6210 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:29.262850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04040c4c-9ed9-45cd-85c6-9d48c86e6210 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:29.262850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 652/1309] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 05:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:29.273774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683446-f856-4a0f-8cc8-a316dfec9f2e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:29.274358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683446-f856-4a0f-8cc8-a316dfec9f2e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:29.274924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be683446-f856-4a0f-8cc8-a316dfec9f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:29.375962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-be683446-f856-4a0f-8cc8-a316dfec9f2e None None] MFA Rules not processed for user `76596e04e82b43cb8b68ee2f5e6dd9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:29.377240 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-be683446-f856-4a0f-8cc8-a316dfec9f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:29.406172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:29.481350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04040c4c-9ed9-45cd-85c6-9d48c86e6210 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:29.484104 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04040c4c-9ed9-45cd-85c6-9d48c86e6210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:29.488639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 658/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 05:29:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:29.607109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04040c4c-9ed9-45cd-85c6-9d48c86e6210 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:29.689661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698643f2-4a1f-4840-b1b4-2c5e7bf33b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:29.690566 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698643f2-4a1f-4840-b1b4-2c5e7bf33b1d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:29.690966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698643f2-4a1f-4840-b1b4-2c5e7bf33b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:29.691246 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698643f2-4a1f-4840-b1b4-2c5e7bf33b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:29.693834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-698643f2-4a1f-4840-b1b4-2c5e7bf33b1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:29.754794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:29.820222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698643f2-4a1f-4840-b1b4-2c5e7bf33b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:29.822273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698643f2-4a1f-4840-b1b4-2c5e7bf33b1d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:29.845570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 653/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:29:32.195650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9022937-dfe8-462d-b112-94e4bc7684e1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:32.196143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9022937-dfe8-462d-b112-94e4bc7684e1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:32.196239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9022937-dfe8-462d-b112-94e4bc7684e1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:32.197619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 659/1312] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:32.202857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb6d09-aeee-403b-a525-db9c77ed7233 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:32.203267 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb6d09-aeee-403b-a525-db9c77ed7233 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:32.203535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb6d09-aeee-403b-a525-db9c77ed7233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:32.274887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-77fb6d09-aeee-403b-a525-db9c77ed7233 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:32.275999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-77fb6d09-aeee-403b-a525-db9c77ed7233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:32.374172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 654/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:32.411930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9022937-dfe8-462d-b112-94e4bc7684e1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:32.413508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f9022937-dfe8-462d-b112-94e4bc7684e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:32.518595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9022937-dfe8-462d-b112-94e4bc7684e1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:32.590000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:32.592763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec9970-c483-49a4-a67d-bab454169776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:32.593419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec9970-c483-49a4-a67d-bab454169776 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:32.593701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec9970-c483-49a4-a67d-bab454169776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:32.593972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec9970-c483-49a4-a67d-bab454169776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:32.595592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-81ec9970-c483-49a4-a67d-bab454169776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:32.716490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec9970-c483-49a4-a67d-bab454169776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:32.717995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec9970-c483-49a4-a67d-bab454169776 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:32.738517 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 660/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:35.531587 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ba2c0-58fb-4437-a4e2-4acc4beb6090 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:35.532177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ba2c0-58fb-4437-a4e2-4acc4beb6090 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:35.532177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ba2c0-58fb-4437-a4e2-4acc4beb6090 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:35.533522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 655/1315] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:35.538641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13044e0c-553a-4e48-9e8c-35c287f8d8b4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:35.539088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13044e0c-553a-4e48-9e8c-35c287f8d8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:35.539193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13044e0c-553a-4e48-9e8c-35c287f8d8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:35.604482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-13044e0c-553a-4e48-9e8c-35c287f8d8b4 None None] MFA Rules not processed for user `a2a04f508a86457da1ddb1c8676d939d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:35.605734 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-13044e0c-553a-4e48-9e8c-35c287f8d8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:35.657705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:35.702080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 661/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:29:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:35.741838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ba2c0-58fb-4437-a4e2-4acc4beb6090 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:35.743386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-533ba2c0-58fb-4437-a4e2-4acc4beb6090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:35.753216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:35.844622 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ba2c0-58fb-4437-a4e2-4acc4beb6090 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:35.920778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89260d6b-d2c3-4aa1-86c7-5f061715a58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:35.921411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89260d6b-d2c3-4aa1-86c7-5f061715a58d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:35.921689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89260d6b-d2c3-4aa1-86c7-5f061715a58d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:35.921954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89260d6b-d2c3-4aa1-86c7-5f061715a58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:35.923557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-89260d6b-d2c3-4aa1-86c7-5f061715a58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:35.986791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:36.033640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89260d6b-d2c3-4aa1-86c7-5f061715a58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:36.035160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89260d6b-d2c3-4aa1-86c7-5f061715a58d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:36.053431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 656/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:38.805280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41197-9b08-4e55-9942-e40053f0bbb2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:38.805843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41197-9b08-4e55-9942-e40053f0bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:38.805843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41197-9b08-4e55-9942-e40053f0bbb2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:38.807164 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 662/1318] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:38.812759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74748565-df89-4cca-a605-b8ab1dcf33b4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:38.813198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74748565-df89-4cca-a605-b8ab1dcf33b4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:38.813363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74748565-df89-4cca-a605-b8ab1dcf33b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:38.878207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-74748565-df89-4cca-a605-b8ab1dcf33b4 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:38.879407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-74748565-df89-4cca-a605-b8ab1dcf33b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:38.973726 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 657/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:39.011546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41197-9b08-4e55-9942-e40053f0bbb2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:39.013821 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3fa41197-9b08-4e55-9942-e40053f0bbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:39.115914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41197-9b08-4e55-9942-e40053f0bbb2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:39.188971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59ed6e-e8d6-4181-b026-19cc9661903d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:39.189615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59ed6e-e8d6-4181-b026-19cc9661903d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:39.189890 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59ed6e-e8d6-4181-b026-19cc9661903d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:39.190156 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59ed6e-e8d6-4181-b026-19cc9661903d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:39.191766 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3d59ed6e-e8d6-4181-b026-19cc9661903d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:39.199008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:39.297311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59ed6e-e8d6-4181-b026-19cc9661903d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:39.298789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59ed6e-e8d6-4181-b026-19cc9661903d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:39.317500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 663/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:42.280973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4181ad-8f18-4de3-96ed-0b61d20c7d0d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:42.281517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4181ad-8f18-4de3-96ed-0b61d20c7d0d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:42.281517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4181ad-8f18-4de3-96ed-0b61d20c7d0d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:42.282845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 658/1321] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:42.288110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dedfc7-11c4-43b4-bff5-462d0bf6794d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:42.288527 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dedfc7-11c4-43b4-bff5-462d0bf6794d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:42.288664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dedfc7-11c4-43b4-bff5-462d0bf6794d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:42.354593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-97dedfc7-11c4-43b4-bff5-462d0bf6794d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:42.355801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-97dedfc7-11c4-43b4-bff5-462d0bf6794d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:42.413684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:42.454005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 664/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:42.506421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45d753-9548-4aab-87b5-f4181fe2cb3d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:42.506794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45d753-9548-4aab-87b5-f4181fe2cb3d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:42.507405 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45d753-9548-4aab-87b5-f4181fe2cb3d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:42.508849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 659/1323] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 05:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:42.516861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8e7d7-39b8-45cf-9f75-a77e578ae6ae None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:42.517175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8e7d7-39b8-45cf-9f75-a77e578ae6ae None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:42.517455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8e7d7-39b8-45cf-9f75-a77e578ae6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:42.610934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-49e8e7d7-39b8-45cf-9f75-a77e578ae6ae None None] MFA Rules not processed for user `76596e04e82b43cb8b68ee2f5e6dd9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:42.612157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-49e8e7d7-39b8-45cf-9f75-a77e578ae6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:42.700329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 665/1324] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 05:29:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:42.710096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45d753-9548-4aab-87b5-f4181fe2cb3d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:42.712256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af45d753-9548-4aab-87b5-f4181fe2cb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:42.739920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:42.838486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45d753-9548-4aab-87b5-f4181fe2cb3d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:42.931386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576461c2-55c7-4200-a522-4af8aa4125bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:42.932570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576461c2-55c7-4200-a522-4af8aa4125bd service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:42.932853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576461c2-55c7-4200-a522-4af8aa4125bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:42.933123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576461c2-55c7-4200-a522-4af8aa4125bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:42.935643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-576461c2-55c7-4200-a522-4af8aa4125bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:43.027725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:43.067771 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576461c2-55c7-4200-a522-4af8aa4125bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:43.069274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576461c2-55c7-4200-a522-4af8aa4125bd service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:43.093159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 660/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:45.387970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd45f0-60b9-4cd0-8e57-494a6a76b8f6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:45.388506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd45f0-60b9-4cd0-8e57-494a6a76b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:45.388667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd45f0-60b9-4cd0-8e57-494a6a76b8f6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:45.390059 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 666/1326] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:45.395691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df818591-66bc-48d6-93a7-2ef6ba17ead7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:45.396118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df818591-66bc-48d6-93a7-2ef6ba17ead7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:45.396212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df818591-66bc-48d6-93a7-2ef6ba17ead7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:45.465040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-df818591-66bc-48d6-93a7-2ef6ba17ead7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:45.466377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-df818591-66bc-48d6-93a7-2ef6ba17ead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:45.563874 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 661/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:45.601479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd45f0-60b9-4cd0-8e57-494a6a76b8f6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:45.603049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cbfd45f0-60b9-4cd0-8e57-494a6a76b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:45.665667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:45.709096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd45f0-60b9-4cd0-8e57-494a6a76b8f6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:45.781957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2cc07-0bf2-4e8f-ae2e-6084db039468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:45.782681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2cc07-0bf2-4e8f-ae2e-6084db039468 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:45.783050 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2cc07-0bf2-4e8f-ae2e-6084db039468 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:45.783387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2cc07-0bf2-4e8f-ae2e-6084db039468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:45.785102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e9f2cc07-0bf2-4e8f-ae2e-6084db039468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:45.904198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:45.906720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2cc07-0bf2-4e8f-ae2e-6084db039468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:45.908165 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2cc07-0bf2-4e8f-ae2e-6084db039468 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:45.929277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 667/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:48.030595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ecc0-428a-4c67-b2ae-ad21b34a716c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:48.031472 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ecc0-428a-4c67-b2ae-ad21b34a716c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:48.031757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ecc0-428a-4c67-b2ae-ad21b34a716c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:48.033194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 662/1329] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:48.038682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d79099-1721-4f22-93eb-552d9dbf0307 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:48.039089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d79099-1721-4f22-93eb-552d9dbf0307 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:48.039234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d79099-1721-4f22-93eb-552d9dbf0307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:48.105191 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e2d79099-1721-4f22-93eb-552d9dbf0307 None None] MFA Rules not processed for user `a2a04f508a86457da1ddb1c8676d939d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:48.107109 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e2d79099-1721-4f22-93eb-552d9dbf0307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:48.206013 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 668/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:29:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:48.243184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ecc0-428a-4c67-b2ae-ad21b34a716c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:48.244721 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ea93ecc0-428a-4c67-b2ae-ad21b34a716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:48.276448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:48.350369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ecc0-428a-4c67-b2ae-ad21b34a716c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:48.441091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c8c71-dcc9-45b6-81a2-dd0bfed46e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:48.441770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c8c71-dcc9-45b6-81a2-dd0bfed46e2f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:48.442051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c8c71-dcc9-45b6-81a2-dd0bfed46e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:48.442321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c8c71-dcc9-45b6-81a2-dd0bfed46e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:48.444000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-275c8c71-dcc9-45b6-81a2-dd0bfed46e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:48.527510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:48.559978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c8c71-dcc9-45b6-81a2-dd0bfed46e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:48.562228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c8c71-dcc9-45b6-81a2-dd0bfed46e2f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:48.580526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 663/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:51.347117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef298298-1d73-4651-8ef7-626b2192ace1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:51.347646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef298298-1d73-4651-8ef7-626b2192ace1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:51.347646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef298298-1d73-4651-8ef7-626b2192ace1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:51.348984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 669/1332] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:51.354035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09bb99-6ed0-4a33-ad45-216211c840bd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:51.354435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09bb99-6ed0-4a33-ad45-216211c840bd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:51.354586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09bb99-6ed0-4a33-ad45-216211c840bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:51.420679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3b09bb99-6ed0-4a33-ad45-216211c840bd None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:51.421949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3b09bb99-6ed0-4a33-ad45-216211c840bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:51.515938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 664/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:29:51.552842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef298298-1d73-4651-8ef7-626b2192ace1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:51.554394 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ef298298-1d73-4651-8ef7-626b2192ace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:51.741701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:51.774133 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef298298-1d73-4651-8ef7-626b2192ace1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:51.847904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b89541-9ef2-4404-821e-239a5cc433a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:51.848546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b89541-9ef2-4404-821e-239a5cc433a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:51.848826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b89541-9ef2-4404-821e-239a5cc433a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:51.849098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b89541-9ef2-4404-821e-239a5cc433a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:51.850739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f3b89541-9ef2-4404-821e-239a5cc433a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:51.957338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b89541-9ef2-4404-821e-239a5cc433a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:51.958756 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b89541-9ef2-4404-821e-239a5cc433a2 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:51.968545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:51.976672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 670/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:54.024009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6bf75-6df9-43ad-8187-cdbf237d97f7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:54.024604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6bf75-6df9-43ad-8187-cdbf237d97f7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:54.024604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6bf75-6df9-43ad-8187-cdbf237d97f7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:54.026004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 665/1335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:29:54.031819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe4e35-0f15-4008-a2f3-a74236e7209d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:54.032220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe4e35-0f15-4008-a2f3-a74236e7209d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:54.032363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe4e35-0f15-4008-a2f3-a74236e7209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:54.099985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2afe4e35-0f15-4008-a2f3-a74236e7209d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:54.101206 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2afe4e35-0f15-4008-a2f3-a74236e7209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:54.196419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 671/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:54.236831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6bf75-6df9-43ad-8187-cdbf237d97f7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:54.238438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2bf6bf75-6df9-43ad-8187-cdbf237d97f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:54.277617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:54.339695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6bf75-6df9-43ad-8187-cdbf237d97f7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:54.411228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71b873-7114-4ee8-8985-e7699b33435d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:54.411836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71b873-7114-4ee8-8985-e7699b33435d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:54.412113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71b873-7114-4ee8-8985-e7699b33435d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:54.412381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71b873-7114-4ee8-8985-e7699b33435d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:54.414016 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d71b873-7114-4ee8-8985-e7699b33435d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:54.496548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:54.523398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71b873-7114-4ee8-8985-e7699b33435d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:54.524828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d71b873-7114-4ee8-8985-e7699b33435d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:54.543095 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 666/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:29:57.062005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fe79-c992-482f-82cf-b10e6675795d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:57.062526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fe79-c992-482f-82cf-b10e6675795d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:57.062526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fe79-c992-482f-82cf-b10e6675795d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:57.063866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 672/1338] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:29:57.068941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8bc2-d668-4934-b498-e1e18e9db157 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:57.069422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8bc2-d668-4934-b498-e1e18e9db157 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:57.069520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8bc2-d668-4934-b498-e1e18e9db157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:57.134411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f93e8bc2-d668-4934-b498-e1e18e9db157 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:29:57.135596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f93e8bc2-d668-4934-b498-e1e18e9db157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:57.230590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 667/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:29:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:29:57.268418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fe79-c992-482f-82cf-b10e6675795d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:29:57.269962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0994fe79-c992-482f-82cf-b10e6675795d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:57.344157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:29:57.370886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fe79-c992-482f-82cf-b10e6675795d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:29:57.443035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1f5aa-781f-4c86-9aa4-c7f3efce518e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:29:57.443644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1f5aa-781f-4c86-9aa4-c7f3efce518e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:29:57.443923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1f5aa-781f-4c86-9aa4-c7f3efce518e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:29:57.444193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1f5aa-781f-4c86-9aa4-c7f3efce518e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:29:57.445818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-10e1f5aa-781f-4c86-9aa4-c7f3efce518e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:29:57.555529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1f5aa-781f-4c86-9aa4-c7f3efce518e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:29:57.556965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1f5aa-781f-4c86-9aa4-c7f3efce518e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:29:57.575085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 673/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:29:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:01.726948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8894-0654-4872-a4f4-c5f020d91334 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:01.727474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8894-0654-4872-a4f4-c5f020d91334 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:01.727592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8894-0654-4872-a4f4-c5f020d91334 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:01.729048 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 668/1341] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:01.735027 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b964-4d5e-441b-adcb-dffdb3b52851 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:01.735499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b964-4d5e-441b-adcb-dffdb3b52851 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:01.735581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b964-4d5e-441b-adcb-dffdb3b52851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:01.741237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:01.807934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-05e0b964-4d5e-441b-adcb-dffdb3b52851 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:01.812012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-05e0b964-4d5e-441b-adcb-dffdb3b52851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:01.922656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 674/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:01.962355 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d8894-0654-4872-a4f4-c5f020d91334 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:01.963947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2e5d8894-0654-4872-a4f4-c5f020d91334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:02.015067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:02.071638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d8894-0654-4872-a4f4-c5f020d91334 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:02.151966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d3e74-3f57-48ee-b02f-94cd2832b2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:02.152586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d3e74-3f57-48ee-b02f-94cd2832b2ff service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:02.152868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d3e74-3f57-48ee-b02f-94cd2832b2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:02.153157 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d3e74-3f57-48ee-b02f-94cd2832b2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:02.155557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-510d3e74-3f57-48ee-b02f-94cd2832b2ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:02.253783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:02.269839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d3e74-3f57-48ee-b02f-94cd2832b2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:02.276885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d3e74-3f57-48ee-b02f-94cd2832b2ff service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:02.289342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 669/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:05.333708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f153c-40cc-4971-8c3c-d4a865e57976 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:05.334311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f153c-40cc-4971-8c3c-d4a865e57976 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:05.334311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f153c-40cc-4971-8c3c-d4a865e57976 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:05.335725 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 675/1344] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:05.341309 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e76b-34b5-42ad-beda-c7853a0de481 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:05.341795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e76b-34b5-42ad-beda-c7853a0de481 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:05.342108 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e76b-34b5-42ad-beda-c7853a0de481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:05.410442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dca5e76b-34b5-42ad-beda-c7853a0de481 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:05.411629 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dca5e76b-34b5-42ad-beda-c7853a0de481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:05.510874 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 670/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:05.548790 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f153c-40cc-4971-8c3c-d4a865e57976 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:05.550613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a10f153c-40cc-4971-8c3c-d4a865e57976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:05.637824 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:05.655027 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f153c-40cc-4971-8c3c-d4a865e57976 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:05.728795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a213d-9678-4b4b-8d2f-027ab1ecab00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:05.729455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a213d-9678-4b4b-8d2f-027ab1ecab00 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:05.729736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a213d-9678-4b4b-8d2f-027ab1ecab00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:05.730002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a213d-9678-4b4b-8d2f-027ab1ecab00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:05.732144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-340a213d-9678-4b4b-8d2f-027ab1ecab00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:05.842705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a213d-9678-4b4b-8d2f-027ab1ecab00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:05.844138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a213d-9678-4b4b-8d2f-027ab1ecab00 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:05.864231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 676/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:10.027643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463082f-7a7b-4245-ae80-387757f3e141 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:10.028193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463082f-7a7b-4245-ae80-387757f3e141 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:10.028193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463082f-7a7b-4245-ae80-387757f3e141 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:10.036039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70ba31-1f8a-46ca-aabf-ccea2e99f7c7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:10.043443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70ba31-1f8a-46ca-aabf-ccea2e99f7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:10.043443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70ba31-1f8a-46ca-aabf-ccea2e99f7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:10.043638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 671/1347] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:10.053561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:10.117982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9e70ba31-1f8a-46ca-aabf-ccea2e99f7c7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:10.119201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9e70ba31-1f8a-46ca-aabf-ccea2e99f7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:10.232839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 677/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:10.271912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463082f-7a7b-4245-ae80-387757f3e141 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:10.273481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5463082f-7a7b-4245-ae80-387757f3e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:10.334656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:10.385170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463082f-7a7b-4245-ae80-387757f3e141 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:10.466889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe74ed-2c67-44ac-9cf3-c47d71fbab79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:10.467519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe74ed-2c67-44ac-9cf3-c47d71fbab79 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:10.467793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe74ed-2c67-44ac-9cf3-c47d71fbab79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:10.468061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe74ed-2c67-44ac-9cf3-c47d71fbab79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:10.469773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04fe74ed-2c67-44ac-9cf3-c47d71fbab79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:10.580375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:10.583958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe74ed-2c67-44ac-9cf3-c47d71fbab79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:10.585439 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe74ed-2c67-44ac-9cf3-c47d71fbab79 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:10.605353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 672/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:15.811312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2d8d1-1afc-46f5-b2e3-3027b2081a48 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:15.811800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2d8d1-1afc-46f5-b2e3-3027b2081a48 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:15.811911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2d8d1-1afc-46f5-b2e3-3027b2081a48 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:15.813542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 678/1350] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 05:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:15.819096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f30a46-0a57-4dbe-9b6b-28ea881d2dc0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:15.819542 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f30a46-0a57-4dbe-9b6b-28ea881d2dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:15.819634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f30a46-0a57-4dbe-9b6b-28ea881d2dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:15.983975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-31f30a46-0a57-4dbe-9b6b-28ea881d2dc0 None None] MFA Rules not processed for user `a5593bc41bce41b4b44616c355976cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:15.985510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-31f30a46-0a57-4dbe-9b6b-28ea881d2dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:16.191242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 673/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 05:30:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:20.230884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=59 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:20.502582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e513-6b87-472c-9462-6d8fbd864f63 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:20.502770 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e513-6b87-472c-9462-6d8fbd864f63 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:20.503033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e513-6b87-472c-9462-6d8fbd864f63 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:20.504531 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 679/1352] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 05:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:20.509551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbb258-6fd1-4461-9f2c-fd84e39f5675 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:20.510016 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbb258-6fd1-4461-9f2c-fd84e39f5675 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:20.510101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbb258-6fd1-4461-9f2c-fd84e39f5675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:20.566536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:20.589283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6bfbb258-6fd1-4461-9f2c-fd84e39f5675 None None] MFA Rules not processed for user `a5593bc41bce41b4b44616c355976cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:20.590519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6bfbb258-6fd1-4461-9f2c-fd84e39f5675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:20.717303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 674/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 05:30:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:21.939020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880b06e-bdf4-4545-b4a7-78544c78c8e1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:21.939572 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880b06e-bdf4-4545-b4a7-78544c78c8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:21.939572 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880b06e-bdf4-4545-b4a7-78544c78c8e1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:21.941035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 680/1354] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 05:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:21.946019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e2813-fb4f-4324-a7ea-34b3ca1f4d06 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:21.946453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e2813-fb4f-4324-a7ea-34b3ca1f4d06 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:21.946575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e2813-fb4f-4324-a7ea-34b3ca1f4d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:22.025673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-931e2813-fb4f-4324-a7ea-34b3ca1f4d06 None None] MFA Rules not processed for user `a5593bc41bce41b4b44616c355976cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:22.026879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-931e2813-fb4f-4324-a7ea-34b3ca1f4d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:22.068163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:22.135369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 675/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 05:30:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:30:25.605074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355810-e7b2-42d7-9283-56e62f49fce8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:25.605646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355810-e7b2-42d7-9283-56e62f49fce8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:25.605646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355810-e7b2-42d7-9283-56e62f49fce8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:25.607860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 681/1356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:25.613406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f0c79-be04-4a5e-9380-a76f8d45243b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:25.615218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f0c79-be04-4a5e-9380-a76f8d45243b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:25.616449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f0c79-be04-4a5e-9380-a76f8d45243b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:25.695042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6a5f0c79-be04-4a5e-9380-a76f8d45243b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:25.696558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6a5f0c79-be04-4a5e-9380-a76f8d45243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:25.797650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 676/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:25.854131 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2175366-d88b-415a-8d4d-ee8a0da65a04 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:25.854662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2175366-d88b-415a-8d4d-ee8a0da65a04 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:25.855221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2175366-d88b-415a-8d4d-ee8a0da65a04 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:25.856832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 682/1358] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 05:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:25.865303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5704220-b531-4f17-ba4d-7330e1e01077 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:25.865597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5704220-b531-4f17-ba4d-7330e1e01077 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:25.865871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5704220-b531-4f17-ba4d-7330e1e01077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:25.883006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:25.950570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a5704220-b531-4f17-ba4d-7330e1e01077 None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:25.951780 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a5704220-b531-4f17-ba4d-7330e1e01077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:26.084801 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 677/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 05:30:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:26.093538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2175366-d88b-415a-8d4d-ee8a0da65a04 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:26.095042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f2175366-d88b-415a-8d4d-ee8a0da65a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:26.251738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2175366-d88b-415a-8d4d-ee8a0da65a04 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:26.342214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:26.380692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917ca50-c8e5-406b-9590-65a61533e24f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:26.381343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ca50-c8e5-406b-9590-65a61533e24f service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:26.381624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ca50-c8e5-406b-9590-65a61533e24f service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:26.381893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ca50-c8e5-406b-9590-65a61533e24f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:26.383481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2917ca50-c8e5-406b-9590-65a61533e24f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:26.484215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917ca50-c8e5-406b-9590-65a61533e24f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:26.486066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917ca50-c8e5-406b-9590-65a61533e24f service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:26.508076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 683/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:28.759037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca8ecd-f787-4f86-b798-2f61292c4c75 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:28.759556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca8ecd-f787-4f86-b798-2f61292c4c75 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:28.759556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca8ecd-f787-4f86-b798-2f61292c4c75 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:28.760994 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 678/1361] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:28.766712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e6f89-aa8f-4c8b-8bfa-fe4e12b1fcd5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:28.767133 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e6f89-aa8f-4c8b-8bfa-fe4e12b1fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:28.767268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e6f89-aa8f-4c8b-8bfa-fe4e12b1fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:28.844720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-340e6f89-aa8f-4c8b-8bfa-fe4e12b1fcd5 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:28.845892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-340e6f89-aa8f-4c8b-8bfa-fe4e12b1fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:28.886042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:28.949209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 684/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:28.994315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca8ecd-f787-4f86-b798-2f61292c4c75 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:28.995952 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-72ca8ecd-f787-4f86-b798-2f61292c4c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:29.076261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:29.183822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca8ecd-f787-4f86-b798-2f61292c4c75 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:29.325868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495128b2-57fc-4998-94df-b27a54af5853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:29.326231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495128b2-57fc-4998-94df-b27a54af5853 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:29.326553 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495128b2-57fc-4998-94df-b27a54af5853 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:29.327022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495128b2-57fc-4998-94df-b27a54af5853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:29.328767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-495128b2-57fc-4998-94df-b27a54af5853 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:29.354071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:29.432201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495128b2-57fc-4998-94df-b27a54af5853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:29.433859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495128b2-57fc-4998-94df-b27a54af5853 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:29.453444 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 679/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:31.967761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a03d64-4814-456f-b2f8-5944737101de None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:31.967761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a03d64-4814-456f-b2f8-5944737101de None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:31.967761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a03d64-4814-456f-b2f8-5944737101de None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:31.967761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 685/1364] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:31.974030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d590-5785-4817-a896-6a03854f4feb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:31.974454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d590-5785-4817-a896-6a03854f4feb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:31.974548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d590-5785-4817-a896-6a03854f4feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:32.079412 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6be3d590-5785-4817-a896-6a03854f4feb None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:32.080708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6be3d590-5785-4817-a896-6a03854f4feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:32.215233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:32.235662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 680/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:32.288608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e60c2-275a-4af4-9a97-854b6909838c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:32.289239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e60c2-275a-4af4-9a97-854b6909838c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:32.289678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e60c2-275a-4af4-9a97-854b6909838c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:32.292839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 686/1366] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 05:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:32.297886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c16fb5-bf3a-49aa-a318-42d525663597 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:32.298169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c16fb5-bf3a-49aa-a318-42d525663597 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:32.298443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c16fb5-bf3a-49aa-a318-42d525663597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:32.436157 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-99c16fb5-bf3a-49aa-a318-42d525663597 None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:32.436157 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-99c16fb5-bf3a-49aa-a318-42d525663597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:32.578369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 681/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 05:30:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:32.585950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e60c2-275a-4af4-9a97-854b6909838c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:32.587980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba8e60c2-275a-4af4-9a97-854b6909838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:32.774450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e60c2-275a-4af4-9a97-854b6909838c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:32.800281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:32.916323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979fcbe-c3be-4759-ae62-777ac1202beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:32.917094 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979fcbe-c3be-4759-ae62-777ac1202beb service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:32.917402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979fcbe-c3be-4759-ae62-777ac1202beb service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:32.917674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979fcbe-c3be-4759-ae62-777ac1202beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:32.919555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3979fcbe-c3be-4759-ae62-777ac1202beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:33.025299 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979fcbe-c3be-4759-ae62-777ac1202beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:33.026902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979fcbe-c3be-4759-ae62-777ac1202beb service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:33.048173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 687/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:30:34.003029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801b031-d3d1-4697-9cfa-a1663b0c70c6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:34.003553 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801b031-d3d1-4697-9cfa-a1663b0c70c6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:34.003638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801b031-d3d1-4697-9cfa-a1663b0c70c6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:34.007970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 682/1369] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:34.012739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cabc-558c-4b60-a9cd-ef4db8a1f682 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:34.014612 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cabc-558c-4b60-a9cd-ef4db8a1f682 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:34.014906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cabc-558c-4b60-a9cd-ef4db8a1f682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:34.063789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:34.109429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2c73cabc-558c-4b60-a9cd-ef4db8a1f682 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:34.110764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2c73cabc-558c-4b60-a9cd-ef4db8a1f682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:34.227170 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 688/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:34.629622 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ecea-a496-4b86-8779-cb13fb5643f2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:34.629904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ecea-a496-4b86-8779-cb13fb5643f2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:34.630179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ecea-a496-4b86-8779-cb13fb5643f2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:34.631701 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 683/1371] 10.222.0.42 () {54 vars in 964 bytes} [Thu Jul 28 05:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:34.638708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e4f88-bae0-4405-95b2-b4e2a357bc40 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:34.639211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e4f88-bae0-4405-95b2-b4e2a357bc40 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:34.639686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e4f88-bae0-4405-95b2-b4e2a357bc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:34.737015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3c6e4f88-bae0-4405-95b2-b4e2a357bc40 None None] MFA Rules not processed for user `ce47f69d77124bdbbde63374b270b6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:34.738400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3c6e4f88-bae0-4405-95b2-b4e2a357bc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:34.797495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:34.847153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 689/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Thu Jul 28 05:30:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:34.913374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7ecea-a496-4b86-8779-cb13fb5643f2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:34.913374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-07e7ecea-a496-4b86-8779-cb13fb5643f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:34.938165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:34.994545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7ecea-a496-4b86-8779-cb13fb5643f2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:35.094385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa99cc-a20d-4b91-ba10-62500852e9eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:35.095176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa99cc-a20d-4b91-ba10-62500852e9eb service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:35.095562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa99cc-a20d-4b91-ba10-62500852e9eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:35.096245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa99cc-a20d-4b91-ba10-62500852e9eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:35.097673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e6aa99cc-a20d-4b91-ba10-62500852e9eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:35.215006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:35.231616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa99cc-a20d-4b91-ba10-62500852e9eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:35.234050 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa99cc-a20d-4b91-ba10-62500852e9eb service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:35.270666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 684/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:35.410078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bcc8d-ded0-42b5-82b7-cd8f14d03982 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:35.410504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bcc8d-ded0-42b5-82b7-cd8f14d03982 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:35.410661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bcc8d-ded0-42b5-82b7-cd8f14d03982 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:35.412230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 690/1374] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:35.417356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6342-9f15-4fe7-b2e0-d7a3500a2cd9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:35.417782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6342-9f15-4fe7-b2e0-d7a3500a2cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:35.418066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6342-9f15-4fe7-b2e0-d7a3500a2cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:35.506666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-899a6342-9f15-4fe7-b2e0-d7a3500a2cd9 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:35.508050 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-899a6342-9f15-4fe7-b2e0-d7a3500a2cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:35.669184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 685/1375] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:35.709833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bcc8d-ded0-42b5-82b7-cd8f14d03982 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:35.711210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-091bcc8d-ded0-42b5-82b7-cd8f14d03982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:35.924955 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bcc8d-ded0-42b5-82b7-cd8f14d03982 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:35.987323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:36.052928 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b341c-fb2d-4ce9-a45c-219b3b10e680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:36.053579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b341c-fb2d-4ce9-a45c-219b3b10e680 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:36.053855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b341c-fb2d-4ce9-a45c-219b3b10e680 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:36.054123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b341c-fb2d-4ce9-a45c-219b3b10e680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:36.055735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b82b341c-fb2d-4ce9-a45c-219b3b10e680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:36.154694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b341c-fb2d-4ce9-a45c-219b3b10e680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:36.156457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b341c-fb2d-4ce9-a45c-219b3b10e680 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:36.178699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 691/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:38.398269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a80e-dac0-4003-935e-4031c0bb82e7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:38.398764 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a80e-dac0-4003-935e-4031c0bb82e7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:38.398884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a80e-dac0-4003-935e-4031c0bb82e7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:38.400189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 686/1377] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:38.406199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7b7-287a-42dc-9d91-b39f7a9947c1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:38.406647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7b7-287a-42dc-9d91-b39f7a9947c1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:38.406827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7b7-287a-42dc-9d91-b39f7a9947c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:38.480245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7fa4b7b7-287a-42dc-9d91-b39f7a9947c1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:38.482208 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7fa4b7b7-287a-42dc-9d91-b39f7a9947c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:38.489347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:38.618338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 692/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:38.660322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69a80e-dac0-4003-935e-4031c0bb82e7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:38.662022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e69a80e-dac0-4003-935e-4031c0bb82e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:38.732784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:38.826171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69a80e-dac0-4003-935e-4031c0bb82e7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:38.942316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877fe2d-ab1c-4340-aafa-7188e8c556d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:38.945970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877fe2d-ab1c-4340-aafa-7188e8c556d0 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:38.945970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877fe2d-ab1c-4340-aafa-7188e8c556d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:38.945970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877fe2d-ab1c-4340-aafa-7188e8c556d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:38.945970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b877fe2d-ab1c-4340-aafa-7188e8c556d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:38.963618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:39.081470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877fe2d-ab1c-4340-aafa-7188e8c556d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:39.083252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877fe2d-ab1c-4340-aafa-7188e8c556d0 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:39.142180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 687/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:41.347388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205a019-da9f-4a7f-814c-c99428cb00e6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:41.347388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205a019-da9f-4a7f-814c-c99428cb00e6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:41.347388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205a019-da9f-4a7f-814c-c99428cb00e6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:41.350390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 693/1380] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:41.353349 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d984f0a-d0a6-42e9-bfd3-fe7b7a5262ba None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:41.354207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d984f0a-d0a6-42e9-bfd3-fe7b7a5262ba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:41.354695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d984f0a-d0a6-42e9-bfd3-fe7b7a5262ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:41.430418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9d984f0a-d0a6-42e9-bfd3-fe7b7a5262ba None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:41.431628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9d984f0a-d0a6-42e9-bfd3-fe7b7a5262ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:41.527063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:41.535419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 688/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:41.581857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205a019-da9f-4a7f-814c-c99428cb00e6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:41.583461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f205a019-da9f-4a7f-814c-c99428cb00e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:41.765013 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:41.778001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205a019-da9f-4a7f-814c-c99428cb00e6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:41.923951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ce76c-5892-413f-8ef7-c868d0bdbd56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:41.924786 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ce76c-5892-413f-8ef7-c868d0bdbd56 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:41.925067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ce76c-5892-413f-8ef7-c868d0bdbd56 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:41.925407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ce76c-5892-413f-8ef7-c868d0bdbd56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:41.927153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d55ce76c-5892-413f-8ef7-c868d0bdbd56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:42.028695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ce76c-5892-413f-8ef7-c868d0bdbd56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:42.030408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ce76c-5892-413f-8ef7-c868d0bdbd56 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:42.041633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:42.051223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 694/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:44.287948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43d549-c6e9-435c-ac4f-b5aa90cb8766 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:44.288499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43d549-c6e9-435c-ac4f-b5aa90cb8766 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:44.288499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43d549-c6e9-435c-ac4f-b5aa90cb8766 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:44.289957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 689/1383] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:30:44.295861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0443d-4a89-467a-b13d-e67a93a5dbbc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:44.296319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0443d-4a89-467a-b13d-e67a93a5dbbc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:44.296411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0443d-4a89-467a-b13d-e67a93a5dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:44.366390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-13c0443d-4a89-467a-b13d-e67a93a5dbbc None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:44.367651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-13c0443d-4a89-467a-b13d-e67a93a5dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:44.476975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 695/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:44.520295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43d549-c6e9-435c-ac4f-b5aa90cb8766 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:44.521932 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-aa43d549-c6e9-435c-ac4f-b5aa90cb8766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:44.690256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43d549-c6e9-435c-ac4f-b5aa90cb8766 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:44.770765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:44.823988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737687a-eb7a-4dc3-a810-1d2224fe9986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:44.825519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737687a-eb7a-4dc3-a810-1d2224fe9986 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:44.825909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737687a-eb7a-4dc3-a810-1d2224fe9986 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:44.826299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737687a-eb7a-4dc3-a810-1d2224fe9986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:44.828758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c737687a-eb7a-4dc3-a810-1d2224fe9986 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:44.947511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737687a-eb7a-4dc3-a810-1d2224fe9986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:44.950205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737687a-eb7a-4dc3-a810-1d2224fe9986 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:44.972092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 690/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:47.656728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b68379-987c-4d08-804a-6a48f40a5013 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:47.657282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b68379-987c-4d08-804a-6a48f40a5013 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:47.657282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b68379-987c-4d08-804a-6a48f40a5013 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:47.658658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 696/1386] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:47.664624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4fcdf-29c1-4380-ae1d-461c67413058 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:47.665046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4fcdf-29c1-4380-ae1d-461c67413058 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:47.665190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4fcdf-29c1-4380-ae1d-461c67413058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:47.737823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0fc4fcdf-29c1-4380-ae1d-461c67413058 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:47.739068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0fc4fcdf-29c1-4380-ae1d-461c67413058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:47.772487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:47.838884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 691/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:30:47.892572 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b68379-987c-4d08-804a-6a48f40a5013 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:47.894184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-96b68379-987c-4d08-804a-6a48f40a5013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:47.975821 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:48.059224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b68379-987c-4d08-804a-6a48f40a5013 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:48.184810 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc449d8a-a0a4-468d-99e7-580043e3f1fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:48.185523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc449d8a-a0a4-468d-99e7-580043e3f1fe service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:48.185836 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc449d8a-a0a4-468d-99e7-580043e3f1fe service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:48.186147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc449d8a-a0a4-468d-99e7-580043e3f1fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:48.188040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fc449d8a-a0a4-468d-99e7-580043e3f1fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:48.233096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:48.295058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc449d8a-a0a4-468d-99e7-580043e3f1fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:48.296675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc449d8a-a0a4-468d-99e7-580043e3f1fe service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:48.315680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 697/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:50.679553 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511c195-1411-417a-aad7-942cd3e8a854 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:50.680205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511c195-1411-417a-aad7-942cd3e8a854 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:50.680205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511c195-1411-417a-aad7-942cd3e8a854 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:50.681535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 692/1389] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:50.687620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6e42-4924-40f7-bb0d-a44066e2ba6a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:50.688078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6e42-4924-40f7-bb0d-a44066e2ba6a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:50.688184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a6e42-4924-40f7-bb0d-a44066e2ba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:50.754178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e08a6e42-4924-40f7-bb0d-a44066e2ba6a None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:50.755368 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e08a6e42-4924-40f7-bb0d-a44066e2ba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:50.855654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 698/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:30:50.899417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511c195-1411-417a-aad7-942cd3e8a854 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:50.900957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b511c195-1411-417a-aad7-942cd3e8a854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:51.048572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511c195-1411-417a-aad7-942cd3e8a854 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:51.065810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:51.164366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003c166-bb69-4047-a0fc-0be3aa5116fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:51.164986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c166-bb69-4047-a0fc-0be3aa5116fd service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:51.165291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c166-bb69-4047-a0fc-0be3aa5116fd service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:51.165556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c166-bb69-4047-a0fc-0be3aa5116fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:51.167180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0003c166-bb69-4047-a0fc-0be3aa5116fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:51.178333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467801a1-8e62-44f4-8d81-5e3a60a185f6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:51.178622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467801a1-8e62-44f4-8d81-5e3a60a185f6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:51.178923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467801a1-8e62-44f4-8d81-5e3a60a185f6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:51.180529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 699/1391] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:30:51.186300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4011fb-3d3d-45b8-9abd-fd3de19c0022 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:51.186613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4011fb-3d3d-45b8-9abd-fd3de19c0022 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:51.186887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4011fb-3d3d-45b8-9abd-fd3de19c0022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:51.203201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:51.257346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cb4011fb-3d3d-45b8-9abd-fd3de19c0022 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:51.258539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cb4011fb-3d3d-45b8-9abd-fd3de19c0022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:51.261525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003c166-bb69-4047-a0fc-0be3aa5116fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:51.263448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003c166-bb69-4047-a0fc-0be3aa5116fd service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:51.282109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 693/1392] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:51.357172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 700/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:51.412280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75294160-5ec5-4d85-9aec-c67fd38f2b58 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:51.412564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75294160-5ec5-4d85-9aec-c67fd38f2b58 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:51.412833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75294160-5ec5-4d85-9aec-c67fd38f2b58 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:51.414219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 694/1394] 10.222.0.42 () {54 vars in 966 bytes} [Thu Jul 28 05:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:51.419817 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5a85e-818d-4760-80da-7ff12d159fc0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:51.420099 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5a85e-818d-4760-80da-7ff12d159fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:51.420369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5a85e-818d-4760-80da-7ff12d159fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:51.502464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-53a5a85e-818d-4760-80da-7ff12d159fc0 None None] MFA Rules not processed for user `e8753f3c218248abbf8018056c67b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:51.503689 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-53a5a85e-818d-4760-80da-7ff12d159fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:51.542431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:51.590014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 701/1395] 10.222.0.42 () {58 vars in 1063 bytes} [Thu Jul 28 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:51.597680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75294160-5ec5-4d85-9aec-c67fd38f2b58 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:51.599216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-75294160-5ec5-4d85-9aec-c67fd38f2b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:51.625411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:51.707505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75294160-5ec5-4d85-9aec-c67fd38f2b58 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:51.781162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6240b5-d44c-472e-b9a6-988597ab7cf7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8753f3c218248abbf8018056c67b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:51.785281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6240b5-d44c-472e-b9a6-988597ab7cf7 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:51.785281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6240b5-d44c-472e-b9a6-988597ab7cf7 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:51.785281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6240b5-d44c-472e-b9a6-988597ab7cf7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:51.785281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-db6240b5-d44c-472e-b9a6-988597ab7cf7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:51.860985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:51.897955 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6240b5-d44c-472e-b9a6-988597ab7cf7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:51.899464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6240b5-d44c-472e-b9a6-988597ab7cf7 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:51.919776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 695/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:52.822534 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693925e-739d-4838-83d9-052b1afb2415 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:52.823052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693925e-739d-4838-83d9-052b1afb2415 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:52.823160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693925e-739d-4838-83d9-052b1afb2415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:52.889866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c693925e-739d-4838-83d9-052b1afb2415 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:52.891076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c693925e-739d-4838-83d9-052b1afb2415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:52.980202 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 702/1397] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:30:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:53.024068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264adcc-5bfb-410e-a09c-5ff6cb88505e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:53.024557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264adcc-5bfb-410e-a09c-5ff6cb88505e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:53.024656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264adcc-5bfb-410e-a09c-5ff6cb88505e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:53.026018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 696/1398] 10.222.0.42 () {54 vars in 943 bytes} [Thu Jul 28 05:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:53.032956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bfb18-76d2-4d3d-9a97-9fd8dff1002e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:53.033281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bfb18-76d2-4d3d-9a97-9fd8dff1002e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:53.033556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bfb18-76d2-4d3d-9a97-9fd8dff1002e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:53.093881 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:53.111531 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-857bfb18-76d2-4d3d-9a97-9fd8dff1002e None None] MFA Rules not processed for user `ef24fa7356ac455b8994e0e6d1959654`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:53.112723 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-857bfb18-76d2-4d3d-9a97-9fd8dff1002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:53.221719 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 703/1399] 10.222.0.42 () {58 vars in 1040 bytes} [Thu Jul 28 05:30:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:53.231788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264adcc-5bfb-410e-a09c-5ff6cb88505e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:53.233356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d264adcc-5bfb-410e-a09c-5ff6cb88505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:53.367457 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264adcc-5bfb-410e-a09c-5ff6cb88505e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:53.408712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:53.452416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e6b27-5420-467a-b2e2-ce29bf873218 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:53.452701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e6b27-5420-467a-b2e2-ce29bf873218 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:53.452983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e6b27-5420-467a-b2e2-ce29bf873218 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:53.454393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 704/1400] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:30:53.459309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937a29-8c67-4836-be5c-7901c1bae1a1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:53.459591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937a29-8c67-4836-be5c-7901c1bae1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:53.459897 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937a29-8c67-4836-be5c-7901c1bae1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:53.471939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac992-d760-4302-b7a5-6d8a24d5cd3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:53.472560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac992-d760-4302-b7a5-6d8a24d5cd3e service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:53.472836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac992-d760-4302-b7a5-6d8a24d5cd3e service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:53.473103 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac992-d760-4302-b7a5-6d8a24d5cd3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:53.474806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e6dac992-d760-4302-b7a5-6d8a24d5cd3e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:53.525992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-72937a29-8c67-4836-be5c-7901c1bae1a1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:53.527735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-72937a29-8c67-4836-be5c-7901c1bae1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:53.558128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dac992-d760-4302-b7a5-6d8a24d5cd3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:53.559798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dac992-d760-4302-b7a5-6d8a24d5cd3e service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:53.567777 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 697/1401] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:30:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:30:53.590239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:53.633179 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 705/1402] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:30:53.677665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac992-d760-4302-b7a5-6d8a24d5cd3e service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:53.678858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e6dac992-d760-4302-b7a5-6d8a24d5cd3e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:53.747599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:53.770150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac992-d760-4302-b7a5-6d8a24d5cd3e service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:53.890126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72885697-b928-47ae-bd7f-1fc59cee485d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:53.890697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72885697-b928-47ae-bd7f-1fc59cee485d service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:53.890973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72885697-b928-47ae-bd7f-1fc59cee485d service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:53.891238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72885697-b928-47ae-bd7f-1fc59cee485d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:53.892872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-72885697-b928-47ae-bd7f-1fc59cee485d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:54.002618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72885697-b928-47ae-bd7f-1fc59cee485d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:54.004364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72885697-b928-47ae-bd7f-1fc59cee485d service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:54.009641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:54.026261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 698/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:56.252832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa477-80d9-4bc0-be02-d22b82c07ddc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:56.253397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa477-80d9-4bc0-be02-d22b82c07ddc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:56.253397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa477-80d9-4bc0-be02-d22b82c07ddc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:56.258618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 706/1404] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:56.260236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9adccc-4c15-4893-942a-ed573eb418df None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:56.261022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9adccc-4c15-4893-942a-ed573eb418df None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:56.262097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9adccc-4c15-4893-942a-ed573eb418df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:56.341213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3d9adccc-4c15-4893-942a-ed573eb418df None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:56.342443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3d9adccc-4c15-4893-942a-ed573eb418df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:56.453280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 699/1405] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:30:56.495120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa477-80d9-4bc0-be02-d22b82c07ddc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:56.497422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-01daa477-80d9-4bc0-be02-d22b82c07ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:56.687687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa477-80d9-4bc0-be02-d22b82c07ddc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:56.732308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:56.819119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577f54e-8f78-4d9a-9d6b-6002ece6d24c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:56.820067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f54e-8f78-4d9a-9d6b-6002ece6d24c service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:56.820347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f54e-8f78-4d9a-9d6b-6002ece6d24c service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:56.820624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f54e-8f78-4d9a-9d6b-6002ece6d24c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:56.822280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b577f54e-8f78-4d9a-9d6b-6002ece6d24c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:56.921643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577f54e-8f78-4d9a-9d6b-6002ece6d24c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:56.923592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577f54e-8f78-4d9a-9d6b-6002ece6d24c service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:56.945869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 707/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:30:59.203165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6357b-a081-4d36-ae47-44730da41de7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:59.203723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6357b-a081-4d36-ae47-44730da41de7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:59.203723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6357b-a081-4d36-ae47-44730da41de7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:59.205055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 700/1407] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:30:59.210564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b710ea3-2af4-4a20-9454-3c0026fccf9f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:59.211373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b710ea3-2af4-4a20-9454-3c0026fccf9f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:59.211654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b710ea3-2af4-4a20-9454-3c0026fccf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:59.294009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:59.312382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1b710ea3-2af4-4a20-9454-3c0026fccf9f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:30:59.312382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1b710ea3-2af4-4a20-9454-3c0026fccf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:59.434345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 708/1408] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:30:59.479961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6357b-a081-4d36-ae47-44730da41de7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:30:59.482424 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d6e6357b-a081-4d36-ae47-44730da41de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:59.571136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:59.656509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6357b-a081-4d36-ae47-44730da41de7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:30:59.784297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ec511-b1d7-41c6-8f79-ce6fdef0f195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:30:59.784917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ec511-b1d7-41c6-8f79-ce6fdef0f195 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:30:59.785220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ec511-b1d7-41c6-8f79-ce6fdef0f195 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:30:59.785496 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ec511-b1d7-41c6-8f79-ce6fdef0f195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:30:59.787159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d51ec511-b1d7-41c6-8f79-ce6fdef0f195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:30:59.826950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:30:59.884138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ec511-b1d7-41c6-8f79-ce6fdef0f195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:30:59.885777 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ec511-b1d7-41c6-8f79-ce6fdef0f195 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:30:59.905761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 701/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:09.482184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=44 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:09.902814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=31 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:16.728192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6734067-558a-4785-bf40-3a48301d6ffb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:16.728765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6734067-558a-4785-bf40-3a48301d6ffb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:16.728765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6734067-558a-4785-bf40-3a48301d6ffb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:16.730764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 709/1410] 10.222.0.42 () {54 vars in 918 bytes} [Thu Jul 28 05:31:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:16.735876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3452a4-27a5-4b83-95e7-61197fbeda70 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:16.736315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3452a4-27a5-4b83-95e7-61197fbeda70 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:16.736424 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3452a4-27a5-4b83-95e7-61197fbeda70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:16.813459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3b3452a4-27a5-4b83-95e7-61197fbeda70 None None] MFA Rules not processed for user `a5593bc41bce41b4b44616c355976cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:16.814681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3b3452a4-27a5-4b83-95e7-61197fbeda70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:16.920709 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 702/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Jul 28 05:31:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:16.936807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b012c-c469-48b9-8328-d9406b5b0af3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:16.937088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b012c-c469-48b9-8328-d9406b5b0af3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:16.937390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b012c-c469-48b9-8328-d9406b5b0af3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:16.938710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 710/1412] 10.222.0.42 () {54 vars in 918 bytes} [Thu Jul 28 05:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:16.943286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24402d8e-de47-4e41-baae-0bd7dc8523d2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:16.943604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24402d8e-de47-4e41-baae-0bd7dc8523d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:16.943881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24402d8e-de47-4e41-baae-0bd7dc8523d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:17.016324 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:17.019270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-24402d8e-de47-4e41-baae-0bd7dc8523d2 None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:17.020465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-24402d8e-de47-4e41-baae-0bd7dc8523d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:17.134954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 703/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Jul 28 05:31:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:31:19.620050 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0dd13-51ff-469e-8486-4c78c7f8ce06 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:19.621227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0dd13-51ff-469e-8486-4c78c7f8ce06 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:19.621485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0dd13-51ff-469e-8486-4c78c7f8ce06 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:19.622616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:19.628035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54b3e8-716b-44c2-a490-dd1f7d8a5c70 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:19.628480 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54b3e8-716b-44c2-a490-dd1f7d8a5c70 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:19.628582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54b3e8-716b-44c2-a490-dd1f7d8a5c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:19.693657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ec54b3e8-716b-44c2-a490-dd1f7d8a5c70 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:19.694859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ec54b3e8-716b-44c2-a490-dd1f7d8a5c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:19.747686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:19.788755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:19.833453 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0dd13-51ff-469e-8486-4c78c7f8ce06 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:19.834977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-18d0dd13-51ff-469e-8486-4c78c7f8ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:19.978911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0dd13-51ff-469e-8486-4c78c7f8ce06 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:20.051702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:20.092570 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cdf36-5f45-4046-84a2-7684b94c239f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:20.093216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cdf36-5f45-4046-84a2-7684b94c239f service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:20.093499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cdf36-5f45-4046-84a2-7684b94c239f service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:20.093767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cdf36-5f45-4046-84a2-7684b94c239f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:20.095385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-783cdf36-5f45-4046-84a2-7684b94c239f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:20.183118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cdf36-5f45-4046-84a2-7684b94c239f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:20.184896 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cdf36-5f45-4046-84a2-7684b94c239f service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:20.203147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 712/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:21.109410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98cd00-9b85-4d7d-b6d1-af0b5fa8946b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.109929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98cd00-9b85-4d7d-b6d1-af0b5fa8946b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.110068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98cd00-9b85-4d7d-b6d1-af0b5fa8946b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.111332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:21.116160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924065c-65e5-49cc-986f-6aa170b422af None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.116588 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924065c-65e5-49cc-986f-6aa170b422af None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.116700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924065c-65e5-49cc-986f-6aa170b422af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.192723 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4924065c-65e5-49cc-986f-6aa170b422af None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:21.193943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4924065c-65e5-49cc-986f-6aa170b422af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:21.220777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:21.290132 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:21.441977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98cd00-9b85-4d7d-b6d1-af0b5fa8946b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:21.443458 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9c98cd00-9b85-4d7d-b6d1-af0b5fa8946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:21.589567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98cd00-9b85-4d7d-b6d1-af0b5fa8946b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:21.629893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:21.707484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0043c5-c880-4bd2-b68f-3528a063ef14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:21.708055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0043c5-c880-4bd2-b68f-3528a063ef14 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:21.708331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0043c5-c880-4bd2-b68f-3528a063ef14 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:21.708604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0043c5-c880-4bd2-b68f-3528a063ef14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:21.710269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bf0043c5-c880-4bd2-b68f-3528a063ef14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:21.799900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0043c5-c880-4bd2-b68f-3528a063ef14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:21.801570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0043c5-c880-4bd2-b68f-3528a063ef14 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:21.820237 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 706/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:22.715793 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc0f2f-601e-479d-a3c7-055f46f53814 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.716365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc0f2f-601e-479d-a3c7-055f46f53814 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.716365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc0f2f-601e-479d-a3c7-055f46f53814 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.717687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:22.722595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7537-e373-42d0-ac67-486c792362f3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:22.723044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7537-e373-42d0-ac67-486c792362f3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:22.723149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7537-e373-42d0-ac67-486c792362f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:22.778386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:22.801950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-764b7537-e373-42d0-ac67-486c792362f3 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:22.803309 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-764b7537-e373-42d0-ac67-486c792362f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:22.906388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:23.060404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc0f2f-601e-479d-a3c7-055f46f53814 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:23.061992 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-92fc0f2f-601e-479d-a3c7-055f46f53814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:23.210644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc0f2f-601e-479d-a3c7-055f46f53814 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:23.224524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:23.325960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16159f2c-55cd-42d5-b72a-36c4859b6682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:23.326495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16159f2c-55cd-42d5-b72a-36c4859b6682 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:23.326774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16159f2c-55cd-42d5-b72a-36c4859b6682 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:23.327046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16159f2c-55cd-42d5-b72a-36c4859b6682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:23.328665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-16159f2c-55cd-42d5-b72a-36c4859b6682 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:23.416891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16159f2c-55cd-42d5-b72a-36c4859b6682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:23.419226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16159f2c-55cd-42d5-b72a-36c4859b6682 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:23.437317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 715/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:24.312108 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600df392-0bd8-47ae-b05b-d147d931d696 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.312673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600df392-0bd8-47ae-b05b-d147d931d696 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.312673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600df392-0bd8-47ae-b05b-d147d931d696 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.314056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:24.318869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3e2a3-2ac2-4714-8320-1a7444a38c1e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.319265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3e2a3-2ac2-4714-8320-1a7444a38c1e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.319452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3e2a3-2ac2-4714-8320-1a7444a38c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.339411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.395749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-69b3e2a3-2ac2-4714-8320-1a7444a38c1e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:24.396947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-69b3e2a3-2ac2-4714-8320-1a7444a38c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:24.492114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:24.643259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600df392-0bd8-47ae-b05b-d147d931d696 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:24.644817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-600df392-0bd8-47ae-b05b-d147d931d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:24.754617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.789142 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600df392-0bd8-47ae-b05b-d147d931d696 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:24.900006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a9d09-aedf-44ae-9585-97f4730718e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:24.900619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a9d09-aedf-44ae-9585-97f4730718e7 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:24.900898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a9d09-aedf-44ae-9585-97f4730718e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:24.901191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a9d09-aedf-44ae-9585-97f4730718e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:24.903360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-079a9d09-aedf-44ae-9585-97f4730718e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:24.977153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:24.990297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a9d09-aedf-44ae-9585-97f4730718e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:24.991915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a9d09-aedf-44ae-9585-97f4730718e7 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:25.010663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 709/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:25.874067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5279cd-e66a-460a-b6a5-478c7187dc52 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:25.874639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5279cd-e66a-460a-b6a5-478c7187dc52 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:25.874639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5279cd-e66a-460a-b6a5-478c7187dc52 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.875954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:25.880766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4413b4-78f5-4770-9c13-9c7fd97fdde9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:25.881169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4413b4-78f5-4770-9c13-9c7fd97fdde9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:25.881327 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4413b4-78f5-4770-9c13-9c7fd97fdde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:25.957024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-db4413b4-78f5-4770-9c13-9c7fd97fdde9 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:25.958249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-db4413b4-78f5-4770-9c13-9c7fd97fdde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:26.055994 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:26.205068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5279cd-e66a-460a-b6a5-478c7187dc52 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:26.206607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cd5279cd-e66a-460a-b6a5-478c7187dc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:26.296875 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:26.360526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5279cd-e66a-460a-b6a5-478c7187dc52 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:26.473459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb3630-943b-414d-a00a-30b021edf344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:26.473991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb3630-943b-414d-a00a-30b021edf344 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:26.474268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb3630-943b-414d-a00a-30b021edf344 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:26.474537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb3630-943b-414d-a00a-30b021edf344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:26.476147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-90bb3630-943b-414d-a00a-30b021edf344 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:26.523767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:26.565197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb3630-943b-414d-a00a-30b021edf344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:26.566795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb3630-943b-414d-a00a-30b021edf344 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:26.585495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 718/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:27.457318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88889fb-10cd-45cd-a3c8-cc9f3e78a5e8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:27.457855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88889fb-10cd-45cd-a3c8-cc9f3e78a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:27.457855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88889fb-10cd-45cd-a3c8-cc9f3e78a5e8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:27.459187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:27.464439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137046e-deb2-42ca-99ae-96b041e6d831 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:27.464921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137046e-deb2-42ca-99ae-96b041e6d831 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:27.465014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137046e-deb2-42ca-99ae-96b041e6d831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:27.539542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c137046e-deb2-42ca-99ae-96b041e6d831 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:27.540738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c137046e-deb2-42ca-99ae-96b041e6d831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:27.639372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:27.788818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88889fb-10cd-45cd-a3c8-cc9f3e78a5e8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:27.790315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c88889fb-10cd-45cd-a3c8-cc9f3e78a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:27.840462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:27.936832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88889fb-10cd-45cd-a3c8-cc9f3e78a5e8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:28.048687 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0b2ff-cfb9-49c8-862a-495689834988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:28.049282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0b2ff-cfb9-49c8-862a-495689834988 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:28.049547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0b2ff-cfb9-49c8-862a-495689834988 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:28.049816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0b2ff-cfb9-49c8-862a-495689834988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:28.051438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f6e0b2ff-cfb9-49c8-862a-495689834988 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:28.058402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:28.139388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0b2ff-cfb9-49c8-862a-495689834988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:28.140989 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0b2ff-cfb9-49c8-862a-495689834988 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:28.159497 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 712/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:29.050374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018faa0-7799-4e5b-9766-bc3a6cfc542c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:29.050942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018faa0-7799-4e5b-9766-bc3a6cfc542c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:29.050942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018faa0-7799-4e5b-9766-bc3a6cfc542c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:29.052291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:29.057088 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c0a24-5f7b-4f37-abe0-03be869b4869 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:29.057513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c0a24-5f7b-4f37-abe0-03be869b4869 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:29.058324 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c0a24-5f7b-4f37-abe0-03be869b4869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:29.132306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-627c0a24-5f7b-4f37-abe0-03be869b4869 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:29.133529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-627c0a24-5f7b-4f37-abe0-03be869b4869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:29.201025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:29.230536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:29.381647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018faa0-7799-4e5b-9766-bc3a6cfc542c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:29.383178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4018faa0-7799-4e5b-9766-bc3a6cfc542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:29.401008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:29.531600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018faa0-7799-4e5b-9766-bc3a6cfc542c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:29.617644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:29.643940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca7f18-1059-4152-ae0e-8f573ab4c8e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:29.644563 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca7f18-1059-4152-ae0e-8f573ab4c8e9 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:29.644845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca7f18-1059-4152-ae0e-8f573ab4c8e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:29.645117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca7f18-1059-4152-ae0e-8f573ab4c8e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:29.646844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-59ca7f18-1059-4152-ae0e-8f573ab4c8e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:29.737925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca7f18-1059-4152-ae0e-8f573ab4c8e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:29.739524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca7f18-1059-4152-ae0e-8f573ab4c8e9 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:29.757182 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 721/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:30.609433 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b67a6-4e4a-4f37-8f4a-85494ac917e7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:30.609967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b67a6-4e4a-4f37-8f4a-85494ac917e7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:30.610067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b67a6-4e4a-4f37-8f4a-85494ac917e7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:30.611411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:30.616137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1d54-f029-44d9-84a6-6b8539694bd6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:30.616581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1d54-f029-44d9-84a6-6b8539694bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:30.616679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1d54-f029-44d9-84a6-6b8539694bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:30.692911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-062b1d54-f029-44d9-84a6-6b8539694bd6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:30.694150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-062b1d54-f029-44d9-84a6-6b8539694bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:30.735560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:30.790179 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:30.941101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b67a6-4e4a-4f37-8f4a-85494ac917e7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:30.942665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3b7b67a6-4e4a-4f37-8f4a-85494ac917e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:31.089359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b67a6-4e4a-4f37-8f4a-85494ac917e7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:31.143995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:31.203229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896258d0-f538-41b9-9aff-7ac45b9a1042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:31.203782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896258d0-f538-41b9-9aff-7ac45b9a1042 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:31.204065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896258d0-f538-41b9-9aff-7ac45b9a1042 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:31.204343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896258d0-f538-41b9-9aff-7ac45b9a1042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:31.206018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-896258d0-f538-41b9-9aff-7ac45b9a1042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:31.294874 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896258d0-f538-41b9-9aff-7ac45b9a1042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:31.296488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896258d0-f538-41b9-9aff-7ac45b9a1042 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:31.315072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 715/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:32.171994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220dbc9-8e6a-47d0-9289-94dbfda95252 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:32.172409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220dbc9-8e6a-47d0-9289-94dbfda95252 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:32.172565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220dbc9-8e6a-47d0-9289-94dbfda95252 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:32.174371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:32.179361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9715-becb-46a7-8808-d2855be98973 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:32.179851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9715-becb-46a7-8808-d2855be98973 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:32.180048 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9715-becb-46a7-8808-d2855be98973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:32.255859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1efc9715-becb-46a7-8808-d2855be98973 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:32.256972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1efc9715-becb-46a7-8808-d2855be98973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:32.259025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:32.356556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:32.508956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220dbc9-8e6a-47d0-9289-94dbfda95252 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:32.510433 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2220dbc9-8e6a-47d0-9289-94dbfda95252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:32.657009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220dbc9-8e6a-47d0-9289-94dbfda95252 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:32.684668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:32.771009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb020c8-5cd9-4147-ac15-85700e2481bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:32.771565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb020c8-5cd9-4147-ac15-85700e2481bb service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:32.771843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb020c8-5cd9-4147-ac15-85700e2481bb service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:32.772111 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb020c8-5cd9-4147-ac15-85700e2481bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:32.773812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-acb020c8-5cd9-4147-ac15-85700e2481bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:32.862624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb020c8-5cd9-4147-ac15-85700e2481bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:32.864213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb020c8-5cd9-4147-ac15-85700e2481bb service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:32.882061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 724/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:34.813384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529e22a-f5b0-4185-bfab-89e0e37cc41c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:34.813947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529e22a-f5b0-4185-bfab-89e0e37cc41c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:34.813947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529e22a-f5b0-4185-bfab-89e0e37cc41c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:34.815277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:34.820529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9108e3e-9a03-417e-8bcf-862e6622a1ae None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:34.820997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9108e3e-9a03-417e-8bcf-862e6622a1ae None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:34.821096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9108e3e-9a03-417e-8bcf-862e6622a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:34.861563 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:34.886837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b9108e3e-9a03-417e-8bcf-862e6622a1ae None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:34.888031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b9108e3e-9a03-417e-8bcf-862e6622a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:34.983440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:35.022726 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529e22a-f5b0-4185-bfab-89e0e37cc41c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:35.024275 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b529e22a-f5b0-4185-bfab-89e0e37cc41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:35.128078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529e22a-f5b0-4185-bfab-89e0e37cc41c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:35.160368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:35.203847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298d280-9400-4a8e-bb27-c07922be9bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:35.204462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d280-9400-4a8e-bb27-c07922be9bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:35.204738 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d280-9400-4a8e-bb27-c07922be9bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:35.205005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d280-9400-4a8e-bb27-c07922be9bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:35.206632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c298d280-9400-4a8e-bb27-c07922be9bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:35.313996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298d280-9400-4a8e-bb27-c07922be9bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:35.316315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298d280-9400-4a8e-bb27-c07922be9bc3 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:35.334881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 718/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:37.528940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c1102-775c-4eae-973c-edf1dc0422f8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:37.529510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c1102-775c-4eae-973c-edf1dc0422f8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:37.529510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c1102-775c-4eae-973c-edf1dc0422f8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:37.530781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:37.536286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ecc4-f33f-4641-8aa6-78184d368fa6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:37.536721 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ecc4-f33f-4641-8aa6-78184d368fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:37.536905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ecc4-f33f-4641-8aa6-78184d368fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:37.603215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4170ecc4-f33f-4641-8aa6-78184d368fa6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:37.604603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4170ecc4-f33f-4641-8aa6-78184d368fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:37.617852 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:37.701441 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:37.738677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c1102-775c-4eae-973c-edf1dc0422f8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:37.740212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-225c1102-775c-4eae-973c-edf1dc0422f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:37.845211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c1102-775c-4eae-973c-edf1dc0422f8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:37.857281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:37.918369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f44d90-b357-47ce-9d04-fbdb80f859eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:37.918973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f44d90-b357-47ce-9d04-fbdb80f859eb service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:37.919247 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f44d90-b357-47ce-9d04-fbdb80f859eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:37.919513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f44d90-b357-47ce-9d04-fbdb80f859eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:37.921103 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-85f44d90-b357-47ce-9d04-fbdb80f859eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:38.029922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f44d90-b357-47ce-9d04-fbdb80f859eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:38.031346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f44d90-b357-47ce-9d04-fbdb80f859eb service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:38.049886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 727/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:40.496697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f8ce3-095e-459a-804c-6172db53baa2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:40.497224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f8ce3-095e-459a-804c-6172db53baa2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:40.497224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f8ce3-095e-459a-804c-6172db53baa2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:40.498529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:40.503720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed00b0-acdc-40b1-bdf5-8e856e46c22a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:40.504129 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed00b0-acdc-40b1-bdf5-8e856e46c22a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:40.504272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed00b0-acdc-40b1-bdf5-8e856e46c22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:40.552366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:40.571080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-70ed00b0-acdc-40b1-bdf5-8e856e46c22a None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:40.572271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-70ed00b0-acdc-40b1-bdf5-8e856e46c22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:40.669613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:40.708625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f8ce3-095e-459a-804c-6172db53baa2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:40.710238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f8f8ce3-095e-459a-804c-6172db53baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:40.815920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f8ce3-095e-459a-804c-6172db53baa2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:40.855578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:40.889502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f0718-5622-4a15-bc53-b502f853a82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:40.890116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f0718-5622-4a15-bc53-b502f853a82e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:40.890391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f0718-5622-4a15-bc53-b502f853a82e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:40.890658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f0718-5622-4a15-bc53-b502f853a82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:40.892253 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e2f0718-5622-4a15-bc53-b502f853a82e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:41.001840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f0718-5622-4a15-bc53-b502f853a82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:41.003272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f0718-5622-4a15-bc53-b502f853a82e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:41.022263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 721/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:43.143675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b0dde-810b-4285-aab6-88273cb0b287 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:43.144184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b0dde-810b-4285-aab6-88273cb0b287 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:43.144303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b0dde-810b-4285-aab6-88273cb0b287 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:43.145590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:31:43.150818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3873433-39c5-4a32-9ce1-0d7b13cad54a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:43.152052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3873433-39c5-4a32-9ce1-0d7b13cad54a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:43.152052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3873433-39c5-4a32-9ce1-0d7b13cad54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:43.216979 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c3873433-39c5-4a32-9ce1-0d7b13cad54a None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:43.218198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c3873433-39c5-4a32-9ce1-0d7b13cad54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:43.238565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:43.313986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:43.352285 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b0dde-810b-4285-aab6-88273cb0b287 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:43.353848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a40b0dde-810b-4285-aab6-88273cb0b287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:43.457581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b0dde-810b-4285-aab6-88273cb0b287 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:43.477093 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:43.531883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06b9e0-b264-48ae-882b-9c25cf7e29fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:43.532498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06b9e0-b264-48ae-882b-9c25cf7e29fd service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:43.532777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06b9e0-b264-48ae-882b-9c25cf7e29fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:43.533051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06b9e0-b264-48ae-882b-9c25cf7e29fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:43.534682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9c06b9e0-b264-48ae-882b-9c25cf7e29fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:43.642216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06b9e0-b264-48ae-882b-9c25cf7e29fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:43.643565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06b9e0-b264-48ae-882b-9c25cf7e29fd service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:43.661626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 730/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:45.743597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8467-18d0-4f10-86e1-8bb2708b9a6c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:45.744163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8467-18d0-4f10-86e1-8bb2708b9a6c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:45.744163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8467-18d0-4f10-86e1-8bb2708b9a6c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:45.746273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:45.751676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef72ea-b79a-4f5a-9b79-cdde711e1638 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:45.752119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef72ea-b79a-4f5a-9b79-cdde711e1638 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:45.752215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef72ea-b79a-4f5a-9b79-cdde711e1638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:45.824401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:45.827510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5fef72ea-b79a-4f5a-9b79-cdde711e1638 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:45.828743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5fef72ea-b79a-4f5a-9b79-cdde711e1638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:45.941850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:45.990840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a8467-18d0-4f10-86e1-8bb2708b9a6c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:45.992393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fe9a8467-18d0-4f10-86e1-8bb2708b9a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:46.117157 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a8467-18d0-4f10-86e1-8bb2708b9a6c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:46.295109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:46.320107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccb9b2-f691-4da3-aeb7-f976738a1215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:46.320728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccb9b2-f691-4da3-aeb7-f976738a1215 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:46.321006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccb9b2-f691-4da3-aeb7-f976738a1215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:46.321303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccb9b2-f691-4da3-aeb7-f976738a1215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:46.323002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-41ccb9b2-f691-4da3-aeb7-f976738a1215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:46.431805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccb9b2-f691-4da3-aeb7-f976738a1215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:46.433816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccb9b2-f691-4da3-aeb7-f976738a1215 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:46.451666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 724/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:48.549367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a25ae6-a7ec-4d92-a483-d20161731315 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:48.549892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a25ae6-a7ec-4d92-a483-d20161731315 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:48.549892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a25ae6-a7ec-4d92-a483-d20161731315 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:48.551272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:48.556485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0208-998a-4b15-a328-07295473ce28 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:48.556918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0208-998a-4b15-a328-07295473ce28 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:48.557043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0208-998a-4b15-a328-07295473ce28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:48.621793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a1df0208-998a-4b15-a328-07295473ce28 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:48.622992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a1df0208-998a-4b15-a328-07295473ce28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:48.652324 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:48.719599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:48.757567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a25ae6-a7ec-4d92-a483-d20161731315 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:48.759158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-41a25ae6-a7ec-4d92-a483-d20161731315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:48.862533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a25ae6-a7ec-4d92-a483-d20161731315 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:48.891091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:48.938040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802d905-f35f-4745-ba40-2c9a0f7c301e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:48.938653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802d905-f35f-4745-ba40-2c9a0f7c301e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:48.938933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802d905-f35f-4745-ba40-2c9a0f7c301e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:48.939206 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802d905-f35f-4745-ba40-2c9a0f7c301e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:48.940813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a802d905-f35f-4745-ba40-2c9a0f7c301e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:49.049978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802d905-f35f-4745-ba40-2c9a0f7c301e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:49.051426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802d905-f35f-4745-ba40-2c9a0f7c301e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:49.070475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 733/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:31:51.136966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66427-e711-47ff-b850-7fd306eb9c01 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:51.137519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66427-e711-47ff-b850-7fd306eb9c01 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:51.137519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66427-e711-47ff-b850-7fd306eb9c01 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:51.138923 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:51.144318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502198d-95c0-49ba-9bd9-05bbb96c565d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:51.144728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502198d-95c0-49ba-9bd9-05bbb96c565d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:51.144867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502198d-95c0-49ba-9bd9-05bbb96c565d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:51.211989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7502198d-95c0-49ba-9bd9-05bbb96c565d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:51.213274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7502198d-95c0-49ba-9bd9-05bbb96c565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:51.221510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:51.310069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:51.347537 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66427-e711-47ff-b850-7fd306eb9c01 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:51.349101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ebc66427-e711-47ff-b850-7fd306eb9c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:51.451463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66427-e711-47ff-b850-7fd306eb9c01 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:51.507015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:51.524678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53f684-74de-4b3f-820c-c80fc8c9ddb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:51.525322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53f684-74de-4b3f-820c-c80fc8c9ddb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:51.525599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53f684-74de-4b3f-820c-c80fc8c9ddb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:51.526931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53f684-74de-4b3f-820c-c80fc8c9ddb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:51.528552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb53f684-74de-4b3f-820c-c80fc8c9ddb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:51.635577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53f684-74de-4b3f-820c-c80fc8c9ddb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:51.636934 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53f684-74de-4b3f-820c-c80fc8c9ddb2 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:51.655682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 727/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:53.699322 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84779-3d89-4e8d-8da3-2f4081ff73e9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:53.699956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84779-3d89-4e8d-8da3-2f4081ff73e9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:53.699956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84779-3d89-4e8d-8da3-2f4081ff73e9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:53.701250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:53.706641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea930a-ba2d-4c96-84a0-dbded7827985 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:53.707067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea930a-ba2d-4c96-84a0-dbded7827985 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:53.707170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea930a-ba2d-4c96-84a0-dbded7827985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:53.772554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-11ea930a-ba2d-4c96-84a0-dbded7827985 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:53.773767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-11ea930a-ba2d-4c96-84a0-dbded7827985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:53.813634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:53.871722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:53.909373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84779-3d89-4e8d-8da3-2f4081ff73e9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:53.910904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1bb84779-3d89-4e8d-8da3-2f4081ff73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:54.017600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84779-3d89-4e8d-8da3-2f4081ff73e9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:54.054294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:54.089828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcfba1-16d6-49eb-82dd-6bdb93f457c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:54.090436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcfba1-16d6-49eb-82dd-6bdb93f457c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:54.090712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcfba1-16d6-49eb-82dd-6bdb93f457c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:54.090980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcfba1-16d6-49eb-82dd-6bdb93f457c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:54.092610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ffcfba1-16d6-49eb-82dd-6bdb93f457c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:54.199894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcfba1-16d6-49eb-82dd-6bdb93f457c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:54.201397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcfba1-16d6-49eb-82dd-6bdb93f457c2 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:54.219796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 736/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:56.278798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d892a-f468-4034-8654-a38dea1b433c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:56.279438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d892a-f468-4034-8654-a38dea1b433c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:56.279438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d892a-f468-4034-8654-a38dea1b433c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:56.280650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:56.286165 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fb552-5f91-46b9-91f0-413226f183a6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:56.286611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fb552-5f91-46b9-91f0-413226f183a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:56.286772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fb552-5f91-46b9-91f0-413226f183a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:56.353303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e43fb552-5f91-46b9-91f0-413226f183a6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:56.355083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e43fb552-5f91-46b9-91f0-413226f183a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:56.373708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:56.452459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:31:56.489367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d892a-f468-4034-8654-a38dea1b433c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:56.490901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fc2d892a-f468-4034-8654-a38dea1b433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:56.594002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d892a-f468-4034-8654-a38dea1b433c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:56.660196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:56.667521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ef5e3-9884-48ea-8ca5-4e1269af2cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:56.672354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ef5e3-9884-48ea-8ca5-4e1269af2cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:56.672354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ef5e3-9884-48ea-8ca5-4e1269af2cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:56.672354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ef5e3-9884-48ea-8ca5-4e1269af2cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:56.672354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4e8ef5e3-9884-48ea-8ca5-4e1269af2cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:56.783721 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ef5e3-9884-48ea-8ca5-4e1269af2cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:56.785196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ef5e3-9884-48ea-8ca5-4e1269af2cb7 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:56.803631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 730/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:31:58.816604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0d3b-020e-44d9-ae67-933e2ecad608 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:58.817238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0d3b-020e-44d9-ae67-933e2ecad608 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:58.817238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0d3b-020e-44d9-ae67-933e2ecad608 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:58.818513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:31:58.824405 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d19e0-445d-4281-b54d-4dde74f7013c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:58.824811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d19e0-445d-4281-b54d-4dde74f7013c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:58.824936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d19e0-445d-4281-b54d-4dde74f7013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:58.890556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-526d19e0-445d-4281-b54d-4dde74f7013c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:31:58.891691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-526d19e0-445d-4281-b54d-4dde74f7013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:58.939179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:58.987155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:31:59.024352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0d3b-020e-44d9-ae67-933e2ecad608 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:31:59.025942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-063f0d3b-020e-44d9-ae67-933e2ecad608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:59.130381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0d3b-020e-44d9-ae67-933e2ecad608 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:31:59.179396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:31:59.205898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86316fc-2004-489b-9786-c07e6f321ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:31:59.206517 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86316fc-2004-489b-9786-c07e6f321ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:31:59.206796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86316fc-2004-489b-9786-c07e6f321ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:31:59.207065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86316fc-2004-489b-9786-c07e6f321ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:31:59.208749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f86316fc-2004-489b-9786-c07e6f321ca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:31:59.318283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86316fc-2004-489b-9786-c07e6f321ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:31:59.319715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86316fc-2004-489b-9786-c07e6f321ca2 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:31:59.339306 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 739/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:08.985399 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=22 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:09.336019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=66 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:18.986262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50c092-5f65-44c1-890c-9eadbdc88c0e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:18.986855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50c092-5f65-44c1-890c-9eadbdc88c0e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:18.986957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50c092-5f65-44c1-890c-9eadbdc88c0e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:18.988276 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 732/1471] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:32:18.993358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60875b4c-8c51-43f3-a1d1-54274ea8c446 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:18.994337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60875b4c-8c51-43f3-a1d1-54274ea8c446 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:18.994555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60875b4c-8c51-43f3-a1d1-54274ea8c446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:19.060608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-60875b4c-8c51-43f3-a1d1-54274ea8c446 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:19.061832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60875b4c-8c51-43f3-a1d1-54274ea8c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:19.161169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 740/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:19.247835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dad23-71fc-408b-b0b1-9e25ce6cc15e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:19.248117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dad23-71fc-408b-b0b1-9e25ce6cc15e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:19.248415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dad23-71fc-408b-b0b1-9e25ce6cc15e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:19.249839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 733/1473] 10.222.0.42 () {54 vars in 966 bytes} [Thu Jul 28 05:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:32:19.254597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f0638-6643-461c-8c89-36e829c76c40 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:19.254985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f0638-6643-461c-8c89-36e829c76c40 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:19.255155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f0638-6643-461c-8c89-36e829c76c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:19.334201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7a8f0638-6643-461c-8c89-36e829c76c40 None None] MFA Rules not processed for user `e8753f3c218248abbf8018056c67b923`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:19.335385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7a8f0638-6643-461c-8c89-36e829c76c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:19.357152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:19.415220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 741/1474] 10.222.0.42 () {58 vars in 1063 bytes} [Thu Jul 28 05:32:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:32:19.423736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dad23-71fc-408b-b0b1-9e25ce6cc15e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:19.425296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e90dad23-71fc-408b-b0b1-9e25ce6cc15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:19.528757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dad23-71fc-408b-b0b1-9e25ce6cc15e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:19.600312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d021fc-49e5-4350-9c43-4ff48bece953 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8753f3c218248abbf8018056c67b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:19.600918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d021fc-49e5-4350-9c43-4ff48bece953 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:19.601222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d021fc-49e5-4350-9c43-4ff48bece953 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:19.601491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d021fc-49e5-4350-9c43-4ff48bece953 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:19.603703 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38d021fc-49e5-4350-9c43-4ff48bece953 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:19.657308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:19.713748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d021fc-49e5-4350-9c43-4ff48bece953 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:19.715266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d021fc-49e5-4350-9c43-4ff48bece953 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:19.735074 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 734/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:21.828819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0187b-ff35-4dde-a9c2-5f831f845a7c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:21.829358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0187b-ff35-4dde-a9c2-5f831f845a7c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:21.829462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0187b-ff35-4dde-a9c2-5f831f845a7c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:21.830949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 742/1476] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:32:21.836052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f41ad-8a36-416b-b1ea-74992957141e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:21.836505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f41ad-8a36-416b-b1ea-74992957141e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:21.836620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f41ad-8a36-416b-b1ea-74992957141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:21.902980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-048f41ad-8a36-416b-b1ea-74992957141e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:21.904182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-048f41ad-8a36-416b-b1ea-74992957141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:21.999073 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 735/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:22.022084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0187b-ff35-4dde-a9c2-5f831f845a7c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:22.023587 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f3b0187b-ff35-4dde-a9c2-5f831f845a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:22.149613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0187b-ff35-4dde-a9c2-5f831f845a7c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:22.199054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:22.243927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbe7fb-4945-4e16-a030-f462b3874f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:22.244675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbe7fb-4945-4e16-a030-f462b3874f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:22.244953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbe7fb-4945-4e16-a030-f462b3874f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:22.245255 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbe7fb-4945-4e16-a030-f462b3874f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:22.245947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbe7fb-4945-4e16-a030-f462b3874f80 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:22.247661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-2bdbe7fb-4945-4e16-a030-f462b3874f80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:32:22.247661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 28 05:32:22.247661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: Jul 28 05:32:22.248804 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbe7fb-4945-4e16-a030-f462b3874f80 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:22.267794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 743/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 05:32:22 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:32:24.319684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a97a3-b32c-4ebf-a93b-7a37c14c820c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:24.320272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a97a3-b32c-4ebf-a93b-7a37c14c820c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:24.320272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a97a3-b32c-4ebf-a93b-7a37c14c820c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:24.321663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 736/1479] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:32:24.327381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d5280-634c-4b73-85b7-d58ab7819558 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:24.327828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d5280-634c-4b73-85b7-d58ab7819558 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:24.327932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d5280-634c-4b73-85b7-d58ab7819558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:24.393468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1f3d5280-634c-4b73-85b7-d58ab7819558 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:24.394676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1f3d5280-634c-4b73-85b7-d58ab7819558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:24.490070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 744/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:24.532782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a97a3-b32c-4ebf-a93b-7a37c14c820c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:24.534331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6b0a97a3-b32c-4ebf-a93b-7a37c14c820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:24.543870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:24.677477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a97a3-b32c-4ebf-a93b-7a37c14c820c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:24.755821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:24.788452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b5bb5-96e6-48f6-8712-d22f3c0ec535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:24.789073 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b5bb5-96e6-48f6-8712-d22f3c0ec535 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:24.789379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b5bb5-96e6-48f6-8712-d22f3c0ec535 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:24.789652 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b5bb5-96e6-48f6-8712-d22f3c0ec535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:24.791332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-253b5bb5-96e6-48f6-8712-d22f3c0ec535 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:24.878051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b5bb5-96e6-48f6-8712-d22f3c0ec535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:24.879637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b5bb5-96e6-48f6-8712-d22f3c0ec535 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:24.897714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 737/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:27.081644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8c076-d17b-452c-b8b9-fab1c768d1ab None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:27.082216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8c076-d17b-452c-b8b9-fab1c768d1ab None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:27.082216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8c076-d17b-452c-b8b9-fab1c768d1ab None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:27.083554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 745/1482] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:32:27.088896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec29df-f4f9-4ec0-b3e2-aad801585b4f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:27.089380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec29df-f4f9-4ec0-b3e2-aad801585b4f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:27.089493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec29df-f4f9-4ec0-b3e2-aad801585b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:27.156909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c1ec29df-f4f9-4ec0-b3e2-aad801585b4f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:27.158164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c1ec29df-f4f9-4ec0-b3e2-aad801585b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:27.204943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:27.254765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 738/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:27.291196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8c076-d17b-452c-b8b9-fab1c768d1ab None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:27.292756 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-72b8c076-d17b-452c-b8b9-fab1c768d1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:27.316861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:27.396713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8c076-d17b-452c-b8b9-fab1c768d1ab None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:27.470363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb6b00-26cd-4be1-b15e-e41de2562ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:27.470986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb6b00-26cd-4be1-b15e-e41de2562ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:27.471265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb6b00-26cd-4be1-b15e-e41de2562ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:27.471534 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb6b00-26cd-4be1-b15e-e41de2562ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:27.473158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fabb6b00-26cd-4be1-b15e-e41de2562ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:27.547982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:27.582948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb6b00-26cd-4be1-b15e-e41de2562ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:27.584371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb6b00-26cd-4be1-b15e-e41de2562ff5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:27.602644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 746/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:29.667140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379329-1f9c-4cfd-99ab-099b92e55e06 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:29.667678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379329-1f9c-4cfd-99ab-099b92e55e06 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:29.667678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379329-1f9c-4cfd-99ab-099b92e55e06 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:29.668972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 739/1485] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:32:29.674428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9efb7b-331e-47e3-8ec2-5a56d121cbd7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:29.674874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9efb7b-331e-47e3-8ec2-5a56d121cbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:29.675016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9efb7b-331e-47e3-8ec2-5a56d121cbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:29.740602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ed9efb7b-331e-47e3-8ec2-5a56d121cbd7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:29.741899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ed9efb7b-331e-47e3-8ec2-5a56d121cbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:29.838804 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 747/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:29.876379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a379329-1f9c-4cfd-99ab-099b92e55e06 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:29.877977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4a379329-1f9c-4cfd-99ab-099b92e55e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:29.980596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a379329-1f9c-4cfd-99ab-099b92e55e06 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:30.050928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:30.052690 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5746b22-b127-4b8d-a2ff-1eef5f5795bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:30.053328 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746b22-b127-4b8d-a2ff-1eef5f5795bf service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:30.053612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746b22-b127-4b8d-a2ff-1eef5f5795bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:30.053882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746b22-b127-4b8d-a2ff-1eef5f5795bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:30.055497 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d5746b22-b127-4b8d-a2ff-1eef5f5795bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:30.162037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5746b22-b127-4b8d-a2ff-1eef5f5795bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:30.163485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5746b22-b127-4b8d-a2ff-1eef5f5795bf service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:30.182936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 740/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:32.272628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fcae6-2432-4693-b0ce-d6131d5002e3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:32.273208 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fcae6-2432-4693-b0ce-d6131d5002e3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:32.273208 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fcae6-2432-4693-b0ce-d6131d5002e3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:32.274570 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 748/1488] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:32:32.279639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69137-623b-4eb3-ae0c-03a80f01c6ec None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:32.280040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69137-623b-4eb3-ae0c-03a80f01c6ec None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:32.280190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69137-623b-4eb3-ae0c-03a80f01c6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:32.345775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-caa69137-623b-4eb3-ae0c-03a80f01c6ec None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:32.346973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-caa69137-623b-4eb3-ae0c-03a80f01c6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:32.399153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:32.442352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 741/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:32.483671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fcae6-2432-4693-b0ce-d6131d5002e3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:32.485238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-375fcae6-2432-4693-b0ce-d6131d5002e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:32.520728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:32.589270 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fcae6-2432-4693-b0ce-d6131d5002e3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:32.663069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fd1b5-a319-4182-a926-43ff0b68051c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:32.663717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fd1b5-a319-4182-a926-43ff0b68051c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:32.663996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fd1b5-a319-4182-a926-43ff0b68051c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:32.664269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fd1b5-a319-4182-a926-43ff0b68051c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:32.666528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f01fd1b5-a319-4182-a926-43ff0b68051c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:32.746383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:32.774675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fd1b5-a319-4182-a926-43ff0b68051c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:32.776104 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fd1b5-a319-4182-a926-43ff0b68051c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:32.794458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 749/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:35.227178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cb51d-762f-471c-ae00-96801c07e6af None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:35.227805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cb51d-762f-471c-ae00-96801c07e6af None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:35.227805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cb51d-762f-471c-ae00-96801c07e6af None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:35.229126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 742/1491] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 05:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:32:35.234397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7551320-d1a3-4fd3-9f0f-613a4ecc23ea None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:35.234814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7551320-d1a3-4fd3-9f0f-613a4ecc23ea None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:35.234949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7551320-d1a3-4fd3-9f0f-613a4ecc23ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:35.300537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b7551320-d1a3-4fd3-9f0f-613a4ecc23ea None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:32:35.301762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b7551320-d1a3-4fd3-9f0f-613a4ecc23ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:35.397724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 750/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 05:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:32:35.437698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cb51d-762f-471c-ae00-96801c07e6af None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:32:35.439227 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9f8cb51d-762f-471c-ae00-96801c07e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:35.541518 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cb51d-762f-471c-ae00-96801c07e6af None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:32:35.613083 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e777d4e-9163-45e1-b2f4-e09695da4c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:32:35.613741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777d4e-9163-45e1-b2f4-e09695da4c3a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:32:35.614022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777d4e-9163-45e1-b2f4-e09695da4c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:32:35.614302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e777d4e-9163-45e1-b2f4-e09695da4c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:32:35.615920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0e777d4e-9163-45e1-b2f4-e09695da4c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:32:35.625826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:35.726135 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e777d4e-9163-45e1-b2f4-e09695da4c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:32:35.727516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e777d4e-9163-45e1-b2f4-e09695da4c3a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:32:35.745683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 743/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:32:45.395868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=82 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:32:45.742893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=50 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:11.950476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fe2e3-6e24-4cc2-b6f1-e1d161f7253c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:11.951083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fe2e3-6e24-4cc2-b6f1-e1d161f7253c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:11.951083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fe2e3-6e24-4cc2-b6f1-e1d161f7253c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:12.028816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5a0fe2e3-6e24-4cc2-b6f1-e1d161f7253c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:12.030053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a0fe2e3-6e24-4cc2-b6f1-e1d161f7253c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:12.130396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 751/1494] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:12.138406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc75ca-33d1-4418-bd01-786497ba3e18 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:12.138911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc75ca-33d1-4418-bd01-786497ba3e18 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:12.139021 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc75ca-33d1-4418-bd01-786497ba3e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:12.214850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-82bc75ca-33d1-4418-bd01-786497ba3e18 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:12.215987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-82bc75ca-33d1-4418-bd01-786497ba3e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:12.312087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 744/1495] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:12.316701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fe2e3-6e24-4cc2-b6f1-e1d161f7253c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:12.317936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a0fe2e3-6e24-4cc2-b6f1-e1d161f7253c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:12.329261 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fe2e3-6e24-4cc2-b6f1-e1d161f7253c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:12.395876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:12.430307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9615d-4c18-4067-8e13-a8e1fe152661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:12.430949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9615d-4c18-4067-8e13-a8e1fe152661 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:12.431229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9615d-4c18-4067-8e13-a8e1fe152661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:12.431498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9615d-4c18-4067-8e13-a8e1fe152661 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:12.432184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9615d-4c18-4067-8e13-a8e1fe152661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:34:12.432481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9615d-4c18-4067-8e13-a8e1fe152661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:12.433520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-28c9615d-4c18-4067-8e13-a8e1fe152661 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:34:12.433520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 28 05:34:12.433520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: Jul 28 05:34:12.434411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9615d-4c18-4067-8e13-a8e1fe152661 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:12.446495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 752/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:34:12.454590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc75ca-33d1-4418-bd01-786497ba3e18 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:12.463736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc75ca-33d1-4418-bd01-786497ba3e18 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:12.523436 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:12.558673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88e7c-3cf2-4429-a39c-10ab3ddc06ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:12.559719 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88e7c-3cf2-4429-a39c-10ab3ddc06ab admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:12.559999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88e7c-3cf2-4429-a39c-10ab3ddc06ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:12.560265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88e7c-3cf2-4429-a39c-10ab3ddc06ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:12.560928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef88e7c-3cf2-4429-a39c-10ab3ddc06ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:12.562708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-cef88e7c-3cf2-4429-a39c-10ab3ddc06ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:34:12.562708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 28 05:34:12.562708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: Jul 28 05:34:12.563893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef88e7c-3cf2-4429-a39c-10ab3ddc06ab admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:12.699000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 745/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:34:12 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:12.703253 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9615d-4c18-4067-8e13-a8e1fe152661 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:12.704778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-28c9615d-4c18-4067-8e13-a8e1fe152661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:12.737831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9615d-4c18-4067-8e13-a8e1fe152661 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:12.830230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3a7f9-44b8-41db-9afc-17d7dea1aa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:12.830852 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3a7f9-44b8-41db-9afc-17d7dea1aa1d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:12.831129 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3a7f9-44b8-41db-9afc-17d7dea1aa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:12.831397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3a7f9-44b8-41db-9afc-17d7dea1aa1d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:12.832045 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3a7f9-44b8-41db-9afc-17d7dea1aa1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:12.833043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-24f3a7f9-44b8-41db-9afc-17d7dea1aa1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:34:12.833043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 28 05:34:12.833043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: Jul 28 05:34:12.834275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3a7f9-44b8-41db-9afc-17d7dea1aa1d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:12.936702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 753/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:34:12 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:34:12.940909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88e7c-3cf2-4429-a39c-10ab3ddc06ab admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:12.942590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cef88e7c-3cf2-4429-a39c-10ab3ddc06ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:13.005770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88e7c-3cf2-4429-a39c-10ab3ddc06ab admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:13.089739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:13.099857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776acefc-667e-4f13-918c-e4c5e378edfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:13.101416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776acefc-667e-4f13-918c-e4c5e378edfa admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:13.101416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776acefc-667e-4f13-918c-e4c5e378edfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:13.101416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776acefc-667e-4f13-918c-e4c5e378edfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:13.101704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776acefc-667e-4f13-918c-e4c5e378edfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:13.102700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-776acefc-667e-4f13-918c-e4c5e378edfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:34:13.102700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 28 05:34:13.102700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: Jul 28 05:34:13.103597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776acefc-667e-4f13-918c-e4c5e378edfa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:13.115672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 746/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:34:13.120304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3a7f9-44b8-41db-9afc-17d7dea1aa1d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:13.121839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-24f3a7f9-44b8-41db-9afc-17d7dea1aa1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:13.133981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3a7f9-44b8-41db-9afc-17d7dea1aa1d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:13.158677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:13.229825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced45bbd-e8bc-4946-88a8-98a87cc74590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:13.230437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45bbd-e8bc-4946-88a8-98a87cc74590 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:13.230711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45bbd-e8bc-4946-88a8-98a87cc74590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:13.230978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45bbd-e8bc-4946-88a8-98a87cc74590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:13.231656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced45bbd-e8bc-4946-88a8-98a87cc74590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:13.232645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-ced45bbd-e8bc-4946-88a8-98a87cc74590 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:34:13.232645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 28 05:34:13.232645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: Jul 28 05:34:13.233560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced45bbd-e8bc-4946-88a8-98a87cc74590 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:13.246851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 754/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:34:13.251112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776acefc-667e-4f13-918c-e4c5e378edfa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:13.252632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-776acefc-667e-4f13-918c-e4c5e378edfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:13.285462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776acefc-667e-4f13-918c-e4c5e378edfa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:13.379522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0114e-4493-45e6-997b-cee0c6bb9b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:13.380110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0114e-4493-45e6-997b-cee0c6bb9b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:13.380416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0114e-4493-45e6-997b-cee0c6bb9b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:13.380688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0114e-4493-45e6-997b-cee0c6bb9b7f admin admin] PATH_INFO: `/v3/projects/3d702af7a2a1412d8b1e4d791639759a/users/93baccbe15a24a15a39e724b0cc8c243/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:13.402308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0114e-4493-45e6-997b-cee0c6bb9b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d702af7a2a1412d8b1e4d791639759a, user_id=93baccbe15a24a15a39e724b0cc8c243, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:13.403360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-97e0114e-4493-45e6-997b-cee0c6bb9b7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:34:13.403360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 28 05:34:13.403360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: Jul 28 05:34:13.405348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0114e-4493-45e6-997b-cee0c6bb9b7f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:13.487345 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 747/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:34:13 2022] PUT /identity/v3/projects/3d702af7a2a1412d8b1e4d791639759a/users/93baccbe15a24a15a39e724b0cc8c243/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:13.500121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73031e3-41b3-487d-878d-2f12d8ce33bd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:13.500400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73031e3-41b3-487d-878d-2f12d8ce33bd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:13.500666 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73031e3-41b3-487d-878d-2f12d8ce33bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:13.557702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b73031e3-41b3-487d-878d-2f12d8ce33bd None None] MFA Rules not processed for user `93baccbe15a24a15a39e724b0cc8c243`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:13.558932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b73031e3-41b3-487d-878d-2f12d8ce33bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:13.643498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 755/1502] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:34:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:13.657239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950aad-9d31-468a-8bb1-bfc08ee8a4b1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:13.657528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950aad-9d31-468a-8bb1-bfc08ee8a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:13.657803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950aad-9d31-468a-8bb1-bfc08ee8a4b1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:13.659180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 748/1503] 10.222.0.42 () {54 vars in 964 bytes} [Thu Jul 28 05:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:34:13.664549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778298f-a316-43f0-8d74-1e7f365ef4c4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:13.664831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778298f-a316-43f0-8d74-1e7f365ef4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:13.665102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778298f-a316-43f0-8d74-1e7f365ef4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:13.695592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:13.739771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6778298f-a316-43f0-8d74-1e7f365ef4c4 None None] MFA Rules not processed for user `ce47f69d77124bdbbde63374b270b6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:13.740974 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6778298f-a316-43f0-8d74-1e7f365ef4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:13.816134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 756/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Thu Jul 28 05:34:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:34:13.824048 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92950aad-9d31-468a-8bb1-bfc08ee8a4b1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:13.825604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-92950aad-9d31-468a-8bb1-bfc08ee8a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:13.876627 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:13.929715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92950aad-9d31-468a-8bb1-bfc08ee8a4b1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:14.002541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38c7b-8472-4052-8dda-cc5107106cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:14.004474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38c7b-8472-4052-8dda-cc5107106cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:14.004474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38c7b-8472-4052-8dda-cc5107106cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:14.004474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38c7b-8472-4052-8dda-cc5107106cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:14.005403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a8f38c7b-8472-4052-8dda-cc5107106cd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:14.103149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38c7b-8472-4052-8dda-cc5107106cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:14.104575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38c7b-8472-4052-8dda-cc5107106cd8 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:14.107997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:14.121635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 749/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:14.170140 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3e732-7598-4a12-a7f0-f9cf0ad6e657 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:14.170548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3e732-7598-4a12-a7f0-f9cf0ad6e657 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:14.170682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3e732-7598-4a12-a7f0-f9cf0ad6e657 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:14.171936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 757/1506] 10.222.0.42 () {52 vars in 830 bytes} [Thu Jul 28 05:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:34:14.175502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38c7b-8472-4052-8dda-cc5107106cd8 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:14.176713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a8f38c7b-8472-4052-8dda-cc5107106cd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:14.273732 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38c7b-8472-4052-8dda-cc5107106cd8 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:14.364583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:14.365246 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:14.365526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:14.365793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] PATH_INFO: `/v3/users/93baccbe15a24a15a39e724b0cc8c243` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:14.378428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] RBAC: Authorizing `identity:delete_user(user_id=93baccbe15a24a15a39e724b0cc8c243)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:14.379447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:34:14.379447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 28 05:34:14.379447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: Jul 28 05:34:14.380667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:14.390678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:14.584020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93baccbe15a24a15a39e724b0cc8c243'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:14.661558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93baccbe15a24a15a39e724b0cc8c243'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:14.662106 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93baccbe15a24a15a39e724b0cc8c243'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:14.662532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93baccbe15a24a15a39e724b0cc8c243'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:14.681566 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93baccbe15a24a15a39e724b0cc8c243'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:14.698855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 750/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:34:14 2022] DELETE /identity/v3/users/93baccbe15a24a15a39e724b0cc8c243 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:14.703210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc43d1-9463-45eb-a787-05178c56c227 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:14.709508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc43d1-9463-45eb-a787-05178c56c227 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:14.709508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc43d1-9463-45eb-a787-05178c56c227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:14.760262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e0bc43d1-9463-45eb-a787-05178c56c227 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:34:14.761478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e0bc43d1-9463-45eb-a787-05178c56c227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:14.834124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:14.846885 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 758/1508] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:34:14.856358 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:14.857622 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:14.955717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65f41a-4405-4581-923f-c5c3c6f7931b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:15.010020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:15.028881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf01fc-ce4f-4da2-a8dc-16e45f25ed60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:15.029523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf01fc-ce4f-4da2-a8dc-16e45f25ed60 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:15.029799 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf01fc-ce4f-4da2-a8dc-16e45f25ed60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:15.030066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf01fc-ce4f-4da2-a8dc-16e45f25ed60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:15.031661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f4bf01fc-ce4f-4da2-a8dc-16e45f25ed60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:15.161949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf01fc-ce4f-4da2-a8dc-16e45f25ed60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:15.163428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf01fc-ce4f-4da2-a8dc-16e45f25ed60 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:15.183354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 751/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:34:15.653686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc43d1-9463-45eb-a787-05178c56c227 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:34:15.654937 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e0bc43d1-9463-45eb-a787-05178c56c227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:34:15.667975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc43d1-9463-45eb-a787-05178c56c227 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:34:15.765833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:34:15.766479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:34:15.766765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:34:15.767037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] PATH_INFO: `/v3/projects/3d702af7a2a1412d8b1e4d791639759a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:34:15.778412 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d702af7a2a1412d8b1e4d791639759a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:34:15.779432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:34:15.779432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 28 05:34:15.779432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: Jul 28 05:34:15.780630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:34:15.878634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d702af7a2a1412d8b1e4d791639759a', 'request_id': 'req-3e98ba1b-dea8-4b08-846f-72e58d0f3139'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:15.891522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d702af7a2a1412d8b1e4d791639759a', 'request_id': 'req-3e98ba1b-dea8-4b08-846f-72e58d0f3139'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:15.898123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d702af7a2a1412d8b1e4d791639759a', 'request_id': 'req-3e98ba1b-dea8-4b08-846f-72e58d0f3139'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:15.978506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] The token cache is being invalidate because project 3d702af7a2a1412d8b1e4d791639759a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:34:15.978712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:15.979166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e98ba1b-dea8-4b08-846f-72e58d0f3139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:34:15.980590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 759/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:34:15 2022] DELETE /identity/v3/projects/3d702af7a2a1412d8b1e4d791639759a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:34:25.180935 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=62 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:34:25.976322 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:00.067348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b1ce-f802-4f8c-a2ba-e1b1e7d0ad6c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:00.067947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b1ce-f802-4f8c-a2ba-e1b1e7d0ad6c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:00.067947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b1ce-f802-4f8c-a2ba-e1b1e7d0ad6c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:00.069440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:36:00.074183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c0ecf-e3e2-4d03-b2d2-b3c3e2342d24 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:00.074590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c0ecf-e3e2-4d03-b2d2-b3c3e2342d24 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:00.074735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c0ecf-e3e2-4d03-b2d2-b3c3e2342d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:00.156728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3e8c0ecf-e3e2-4d03-b2d2-b3c3e2342d24 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:00.157970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3e8c0ecf-e3e2-4d03-b2d2-b3c3e2342d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:00.263485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:00.420163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b1ce-f802-4f8c-a2ba-e1b1e7d0ad6c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:00.422288 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0b27b1ce-f802-4f8c-a2ba-e1b1e7d0ad6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:00.538644 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b1ce-f802-4f8c-a2ba-e1b1e7d0ad6c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:00.544997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3fd88-2bb3-4364-9b13-35998e3a0abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:00.545639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3fd88-2bb3-4364-9b13-35998e3a0abc service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:00.545918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3fd88-2bb3-4364-9b13-35998e3a0abc service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:00.546190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3fd88-2bb3-4364-9b13-35998e3a0abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:00.554151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3fd88-2bb3-4364-9b13-35998e3a0abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:00.555722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3fd88-2bb3-4364-9b13-35998e3a0abc service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:00.565430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 753/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:01.405436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762caefe-0cd6-43c6-8710-3f554c66d492 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:01.405991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762caefe-0cd6-43c6-8710-3f554c66d492 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:01.405991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762caefe-0cd6-43c6-8710-3f554c66d492 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:01.407364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:36:01.412122 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3618e04-9da8-46cc-a0b8-1878b0d91836 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:01.412568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3618e04-9da8-46cc-a0b8-1878b0d91836 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:01.412674 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3618e04-9da8-46cc-a0b8-1878b0d91836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:01.434211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a3618e04-9da8-46cc-a0b8-1878b0d91836 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:01.435406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a3618e04-9da8-46cc-a0b8-1878b0d91836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:01.443244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:01.598723 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762caefe-0cd6-43c6-8710-3f554c66d492 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:01.613671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762caefe-0cd6-43c6-8710-3f554c66d492 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:01.619732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0e1e8-c0a8-49f1-b989-990e575cde9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:01.625249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0e1e8-c0a8-49f1-b989-990e575cde9a service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:01.625249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0e1e8-c0a8-49f1-b989-990e575cde9a service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:01.625249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0e1e8-c0a8-49f1-b989-990e575cde9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:01.629220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0e1e8-c0a8-49f1-b989-990e575cde9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:01.630872 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0e1e8-c0a8-49f1-b989-990e575cde9a service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:01.640462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 762/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:01.933656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc3a58-6da8-4572-b2f2-9addf140fd09 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:01.933875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc3a58-6da8-4572-b2f2-9addf140fd09 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:01.934120 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc3a58-6da8-4572-b2f2-9addf140fd09 None None] PATH_INFO: `/v3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:01.935457 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 755/1517] 10.222.0.47 () {54 vars in 925 bytes} [Thu Jul 28 05:36:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:36:01.942048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545164f-052b-43ac-a97e-75fa6943401b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:01.942336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545164f-052b-43ac-a97e-75fa6943401b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:01.942615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545164f-052b-43ac-a97e-75fa6943401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:02.003752 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0545164f-052b-43ac-a97e-75fa6943401b None None] MFA Rules not processed for user `a5593bc41bce41b4b44616c355976cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:02.004955 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0545164f-052b-43ac-a97e-75fa6943401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:02.022523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:02.078670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 763/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jul 28 05:36:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:06.112127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51b2a-254d-459e-83f8-f32c3cf83c0b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:06.112717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51b2a-254d-459e-83f8-f32c3cf83c0b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:06.112717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51b2a-254d-459e-83f8-f32c3cf83c0b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:06.114072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 756/1519] 10.222.0.42 () {54 vars in 961 bytes} [Thu Jul 28 05:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:36:06.119628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6d4fb-7811-4de8-a242-75f98f1250a4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:06.120072 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6d4fb-7811-4de8-a242-75f98f1250a4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:06.120188 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6d4fb-7811-4de8-a242-75f98f1250a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:06.139681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b3e6d4fb-7811-4de8-a242-75f98f1250a4 None None] MFA Rules not processed for user `a5593bc41bce41b4b44616c355976cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:06.140870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b3e6d4fb-7811-4de8-a242-75f98f1250a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:06.149446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 764/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Thu Jul 28 05:36:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:06.156891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d51b2a-254d-459e-83f8-f32c3cf83c0b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:06.171160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d51b2a-254d-459e-83f8-f32c3cf83c0b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:06.176085 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f13f-7799-4d0d-863d-e344bfd85b65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5593bc41bce41b4b44616c355976cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:06.176686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f13f-7799-4d0d-863d-e344bfd85b65 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:06.176964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f13f-7799-4d0d-863d-e344bfd85b65 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:06.177268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f13f-7799-4d0d-863d-e344bfd85b65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:06.185984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7f13f-7799-4d0d-863d-e344bfd85b65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:06.187562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7f13f-7799-4d0d-863d-e344bfd85b65 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:06.197016 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 757/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:12.868620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b5ad-06cd-456c-a046-b2289d0771ff None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:12.869193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b5ad-06cd-456c-a046-b2289d0771ff None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:12.869193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b5ad-06cd-456c-a046-b2289d0771ff None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:12.870538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:36:12.875351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f805b4-503e-4061-b779-31e03ea10cdb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:12.875746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f805b4-503e-4061-b779-31e03ea10cdb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:12.875901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f805b4-503e-4061-b779-31e03ea10cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:12.895429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a0f805b4-503e-4061-b779-31e03ea10cdb None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:12.896621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a0f805b4-503e-4061-b779-31e03ea10cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:12.905115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:13.060522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0b5ad-06cd-456c-a046-b2289d0771ff None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:13.075166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0b5ad-06cd-456c-a046-b2289d0771ff None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:13.081352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb794b69-928c-4cce-b396-129dcaac4d2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:13.081352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb794b69-928c-4cce-b396-129dcaac4d2d service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:13.081629 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb794b69-928c-4cce-b396-129dcaac4d2d service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:13.081818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb794b69-928c-4cce-b396-129dcaac4d2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:13.090789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb794b69-928c-4cce-b396-129dcaac4d2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:13.092431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb794b69-928c-4cce-b396-129dcaac4d2d service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:13.101770 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 766/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:13.918827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37377a-9f59-46a6-9c39-4a7a63d1a0ba None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:13.919399 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37377a-9f59-46a6-9c39-4a7a63d1a0ba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:13.919399 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37377a-9f59-46a6-9c39-4a7a63d1a0ba None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:13.920768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 05:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:36:13.925467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa8605-9773-43de-827f-4164caa74ae6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:13.925892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa8605-9773-43de-827f-4164caa74ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:13.926012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa8605-9773-43de-827f-4164caa74ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:13.945997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-96aa8605-9773-43de-827f-4164caa74ae6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:13.947437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-96aa8605-9773-43de-827f-4164caa74ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:13.955167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 05:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:14.107845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37377a-9f59-46a6-9c39-4a7a63d1a0ba None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:14.122603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37377a-9f59-46a6-9c39-4a7a63d1a0ba None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:14.128028 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d601bb-dc30-49b4-812d-6f170ca7d8c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:14.128632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d601bb-dc30-49b4-812d-6f170ca7d8c5 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:14.128914 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d601bb-dc30-49b4-812d-6f170ca7d8c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:14.129225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d601bb-dc30-49b4-812d-6f170ca7d8c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:14.137802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d601bb-dc30-49b4-812d-6f170ca7d8c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:14.139412 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d601bb-dc30-49b4-812d-6f170ca7d8c5 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:14.148684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 760/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:17.939525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c6e99-db31-4ac2-8c31-64939da699c4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:17.940047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c6e99-db31-4ac2-8c31-64939da699c4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:17.940047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c6e99-db31-4ac2-8c31-64939da699c4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:17.941522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:36:17.946606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea87fd-5885-4893-8fae-ed60278d5d2f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:17.946998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea87fd-5885-4893-8fae-ed60278d5d2f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:17.947158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea87fd-5885-4893-8fae-ed60278d5d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:17.966656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3fea87fd-5885-4893-8fae-ed60278d5d2f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:17.967835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3fea87fd-5885-4893-8fae-ed60278d5d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:17.975668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:18.049149 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c6e99-db31-4ac2-8c31-64939da699c4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:18.050838 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0b5c6e99-db31-4ac2-8c31-64939da699c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:18.129510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c6e99-db31-4ac2-8c31-64939da699c4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:18.133043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215499b-de78-4b82-9db9-bb507671cbe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:18.133708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215499b-de78-4b82-9db9-bb507671cbe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:18.133990 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215499b-de78-4b82-9db9-bb507671cbe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:18.134257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215499b-de78-4b82-9db9-bb507671cbe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:18.142895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215499b-de78-4b82-9db9-bb507671cbe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:18.144329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215499b-de78-4b82-9db9-bb507671cbe5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:18.157122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 769/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:20.133641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63586-ac07-4fa7-80ed-49b8d5eb5c2a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:20.133641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63586-ac07-4fa7-80ed-49b8d5eb5c2a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:20.134345 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63586-ac07-4fa7-80ed-49b8d5eb5c2a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:20.135334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:36:20.140641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f99b5-f7c8-447c-a3b6-d8a9da5786d4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:20.141051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f99b5-f7c8-447c-a3b6-d8a9da5786d4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:20.141228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f99b5-f7c8-447c-a3b6-d8a9da5786d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:20.161026 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-598f99b5-f7c8-447c-a3b6-d8a9da5786d4 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:20.162238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-598f99b5-f7c8-447c-a3b6-d8a9da5786d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:20.171233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:20.206976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db63586-ac07-4fa7-80ed-49b8d5eb5c2a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:20.218917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db63586-ac07-4fa7-80ed-49b8d5eb5c2a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:20.222370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949c3ef-1d56-4720-928c-7783d42a4ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:20.222965 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949c3ef-1d56-4720-928c-7783d42a4ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:20.223240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949c3ef-1d56-4720-928c-7783d42a4ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:20.223507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949c3ef-1d56-4720-928c-7783d42a4ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:20.233306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949c3ef-1d56-4720-928c-7783d42a4ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:20.234735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949c3ef-1d56-4720-928c-7783d42a4ae6 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:20.244203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 763/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:23.722319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d489-fc78-49a0-b476-f5375f3bddb2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:23.722861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d489-fc78-49a0-b476-f5375f3bddb2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:23.722861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d489-fc78-49a0-b476-f5375f3bddb2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:23.724256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:36:23.730368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d923f-8337-4a8e-816c-87ec87941473 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:23.730779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d923f-8337-4a8e-816c-87ec87941473 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:23.730923 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d923f-8337-4a8e-816c-87ec87941473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:23.750521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dc9d923f-8337-4a8e-816c-87ec87941473 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:23.751722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dc9d923f-8337-4a8e-816c-87ec87941473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:23.759751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:24.065140 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5d489-fc78-49a0-b476-f5375f3bddb2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:24.066877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-63d5d489-fc78-49a0-b476-f5375f3bddb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:24.131394 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:24.144805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5d489-fc78-49a0-b476-f5375f3bddb2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:24.159338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff84b07-c538-4968-bb59-af57634662b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:24.159338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff84b07-c538-4968-bb59-af57634662b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:24.159338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff84b07-c538-4968-bb59-af57634662b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:24.159338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff84b07-c538-4968-bb59-af57634662b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:24.159703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff84b07-c538-4968-bb59-af57634662b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:24.160358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff84b07-c538-4968-bb59-af57634662b5 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:24.170324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 772/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:26.196890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f61bbd-08f1-4875-8ef7-6ff4f25bae96 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:26.197409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f61bbd-08f1-4875-8ef7-6ff4f25bae96 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:26.197506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f61bbd-08f1-4875-8ef7-6ff4f25bae96 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:26.198839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 05:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:36:26.204140 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe27d74-4270-40c7-b40b-1773a02d3116 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:26.204534 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe27d74-4270-40c7-b40b-1773a02d3116 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:26.204726 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe27d74-4270-40c7-b40b-1773a02d3116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:26.224325 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-abe27d74-4270-40c7-b40b-1773a02d3116 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:36:26.225548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-abe27d74-4270-40c7-b40b-1773a02d3116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:26.234003 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 05:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:36:26.537489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f61bbd-08f1-4875-8ef7-6ff4f25bae96 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:36:26.539169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d5f61bbd-08f1-4875-8ef7-6ff4f25bae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:36:26.547377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:26.553160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f61bbd-08f1-4875-8ef7-6ff4f25bae96 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:36:26.557432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2bcf1-1926-45bf-b033-0136a0de9542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:36:26.558052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2bcf1-1926-45bf-b033-0136a0de9542 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:36:26.558333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2bcf1-1926-45bf-b033-0136a0de9542 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:36:26.558609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2bcf1-1926-45bf-b033-0136a0de9542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:36:26.567485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2bcf1-1926-45bf-b033-0136a0de9542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:36:26.570652 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2bcf1-1926-45bf-b033-0136a0de9542 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:36:26.578332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 766/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:36:36.219784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=11 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:36:36.589456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:57.548483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf719b-42a6-4c39-8a39-165e14190fd9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.549089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf719b-42a6-4c39-8a39-165e14190fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.549089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf719b-42a6-4c39-8a39-165e14190fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:57.553055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caf06f-ebfc-4998-b507-06c1e53dde8b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.553536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caf06f-ebfc-4998-b507-06c1e53dde8b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.553658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caf06f-ebfc-4998-b507-06c1e53dde8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:57.573477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dabf719b-42a6-4c39-8a39-165e14190fd9 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:57.574686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dabf719b-42a6-4c39-8a39-165e14190fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:57.580442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-14caf06f-ebfc-4998-b507-06c1e53dde8b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:57.585904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-14caf06f-ebfc-4998-b507-06c1e53dde8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:57.588157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 774/1540] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:57.597482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c00ed-44d4-4609-8d47-50db0832fbce None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.597788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c00ed-44d4-4609-8d47-50db0832fbce None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.598042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c00ed-44d4-4609-8d47-50db0832fbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:57.620880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 767/1541] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:57.623661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc9e89-4bf1-412e-b4ec-bdab4c33b00c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.624087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc9e89-4bf1-412e-b4ec-bdab4c33b00c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.624323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc9e89-4bf1-412e-b4ec-bdab4c33b00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:57.634235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e02c00ed-44d4-4609-8d47-50db0832fbce None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:57.640465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e02c00ed-44d4-4609-8d47-50db0832fbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:57.654124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 775/1542] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:57.658884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c00ed-44d4-4609-8d47-50db0832fbce None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:57.674945 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c00ed-44d4-4609-8d47-50db0832fbce None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:57.678013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dffc9e89-4bf1-412e-b4ec-bdab4c33b00c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:57.679595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237ca70-68a2-44e2-92f3-212a7936d717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:57.679886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dffc9e89-4bf1-412e-b4ec-bdab4c33b00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:57.680221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ca70-68a2-44e2-92f3-212a7936d717 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.680503 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ca70-68a2-44e2-92f3-212a7936d717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.680870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ca70-68a2-44e2-92f3-212a7936d717 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:57.686112 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237ca70-68a2-44e2-92f3-212a7936d717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:57.686439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237ca70-68a2-44e2-92f3-212a7936d717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:57.688114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237ca70-68a2-44e2-92f3-212a7936d717 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:57.708149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 768/1543] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:37:57.712122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 776/1544] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:37:57.715690 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc9e89-4bf1-412e-b4ec-bdab4c33b00c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:57.721704 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237ca70-68a2-44e2-92f3-212a7936d717 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:57.736690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237ca70-68a2-44e2-92f3-212a7936d717 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:57.740861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc9e89-4bf1-412e-b4ec-bdab4c33b00c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:57.746825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46431850-c4b4-43f1-a704-20b441f2b651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:57.747646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431850-c4b4-43f1-a704-20b441f2b651 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.747940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431850-c4b4-43f1-a704-20b441f2b651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.748303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431850-c4b4-43f1-a704-20b441f2b651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:57.748986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46431850-c4b4-43f1-a704-20b441f2b651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:57.750228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-46431850-c4b4-43f1-a704-20b441f2b651 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:37:57.750228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 28 05:37:57.750228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: Jul 28 05:37:57.751530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46431850-c4b4-43f1-a704-20b441f2b651 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:57.752867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d05b-cd65-409c-a75b-e36b89721784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:57.753509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d05b-cd65-409c-a75b-e36b89721784 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.753791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d05b-cd65-409c-a75b-e36b89721784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.754066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d05b-cd65-409c-a75b-e36b89721784 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:57.754774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92d05b-cd65-409c-a75b-e36b89721784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:57.755078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92d05b-cd65-409c-a75b-e36b89721784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:57.756462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-bf92d05b-cd65-409c-a75b-e36b89721784 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:37:57.756462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 28 05:37:57.756462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: Jul 28 05:37:57.757086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92d05b-cd65-409c-a75b-e36b89721784 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:57.787100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 769/1545] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:37:57.796122 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d05b-cd65-409c-a75b-e36b89721784 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:57.811978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d05b-cd65-409c-a75b-e36b89721784 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:57.821333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8318da-c385-4606-974c-61734a42bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:57.821969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8318da-c385-4606-974c-61734a42bf56 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.822252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8318da-c385-4606-974c-61734a42bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.822524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8318da-c385-4606-974c-61734a42bf56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:57.823270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8318da-c385-4606-974c-61734a42bf56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:57.825505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8318da-c385-4606-974c-61734a42bf56 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:57.890703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 777/1546] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:57 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:57.892050 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53014-31a5-4cf9-b4a3-e143193868e5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.892342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53014-31a5-4cf9-b4a3-e143193868e5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.892617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53014-31a5-4cf9-b4a3-e143193868e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:57.914835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 770/1547] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:57 2022] POST /identity/v3/projects => generated 361 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:37:57.925519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-09e53014-31a5-4cf9-b4a3-e143193868e5 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:57.925689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8318da-c385-4606-974c-61734a42bf56 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:57.925783 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-09e53014-31a5-4cf9-b4a3-e143193868e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:57.988117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 778/1548] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:57.989412 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12b01-ab0c-4546-9b8c-74f0538692f1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:57.989697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12b01-ab0c-4546-9b8c-74f0538692f1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:57.989969 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12b01-ab0c-4546-9b8c-74f0538692f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.009718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4cf12b01-ab0c-4546-9b8c-74f0538692f1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:58.011597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4cf12b01-ab0c-4546-9b8c-74f0538692f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.018990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8318da-c385-4606-974c-61734a42bf56 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.029694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 779/1549] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:58.029694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12b01-ab0c-4546-9b8c-74f0538692f1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.034969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d7518-f15e-47fe-9914-a5442565ff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.035617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7518-f15e-47fe-9914-a5442565ff67 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.035897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7518-f15e-47fe-9914-a5442565ff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.036304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7518-f15e-47fe-9914-a5442565ff67 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.036989 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d7518-f15e-47fe-9914-a5442565ff67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.042901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-748d7518-f15e-47fe-9914-a5442565ff67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:37:58.042901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 28 05:37:58.042901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: Jul 28 05:37:58.046910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d7518-f15e-47fe-9914-a5442565ff67 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.047045 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12b01-ab0c-4546-9b8c-74f0538692f1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.050352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce87e6-7b6d-4648-9855-f5a054f9e5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.050979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce87e6-7b6d-4648-9855-f5a054f9e5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.051258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce87e6-7b6d-4648-9855-f5a054f9e5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.051533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce87e6-7b6d-4648-9855-f5a054f9e5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.052195 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce87e6-7b6d-4648-9855-f5a054f9e5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.054426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce87e6-7b6d-4648-9855-f5a054f9e5c7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.165681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 771/1550] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:57 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:58.169432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7cfc8-391c-461f-8704-7a77b8dc632b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.171735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7cfc8-391c-461f-8704-7a77b8dc632b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.174320 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7cfc8-391c-461f-8704-7a77b8dc632b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.177897 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 780/1551] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/users => generated 281 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:58.180959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab975-9566-4071-a91d-f1082c17c3b6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.180959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab975-9566-4071-a91d-f1082c17c3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.180959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab975-9566-4071-a91d-f1082c17c3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.195186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4ce7cfc8-391c-461f-8704-7a77b8dc632b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:58.196403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4ce7cfc8-391c-461f-8704-7a77b8dc632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.200446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-816ab975-9566-4071-a91d-f1082c17c3b6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:58.201745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-816ab975-9566-4071-a91d-f1082c17c3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.205647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 772/1552] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:58.206766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8f623-d868-49b5-ad57-58662afd30f2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.207052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8f623-d868-49b5-ad57-58662afd30f2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.207416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8f623-d868-49b5-ad57-58662afd30f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.213549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 781/1553] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:58.213549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce23e-cf2c-488c-8dd0-6ac4b71257ef None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.213549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce23e-cf2c-488c-8dd0-6ac4b71257ef None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.213549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce23e-cf2c-488c-8dd0-6ac4b71257ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.233054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d4fce23e-cf2c-488c-8dd0-6ac4b71257ef None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:58.234278 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d4fce23e-cf2c-488c-8dd0-6ac4b71257ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.236550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-59e8f623-d868-49b5-ad57-58662afd30f2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:58.237748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-59e8f623-d868-49b5-ad57-58662afd30f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.242225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 782/1554] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:58.242984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fce23e-cf2c-488c-8dd0-6ac4b71257ef None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.245714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 773/1555] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:58.250364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad8b9-9b81-4afe-a207-d04b30d91b8e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.250646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad8b9-9b81-4afe-a207-d04b30d91b8e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.250920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad8b9-9b81-4afe-a207-d04b30d91b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.254963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fce23e-cf2c-488c-8dd0-6ac4b71257ef None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.259898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641d715-d959-4993-a0c2-28797e89841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.261107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641d715-d959-4993-a0c2-28797e89841d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.261452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641d715-d959-4993-a0c2-28797e89841d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.261899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641d715-d959-4993-a0c2-28797e89841d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.262615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641d715-d959-4993-a0c2-28797e89841d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.264236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641d715-d959-4993-a0c2-28797e89841d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.270801 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b3bad8b9-9b81-4afe-a207-d04b30d91b8e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:58.272242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b3bad8b9-9b81-4afe-a207-d04b30d91b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.274768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 783/1556] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:58.278419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641d715-d959-4993-a0c2-28797e89841d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.280909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 774/1557] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:58.281763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bad8b9-9b81-4afe-a207-d04b30d91b8e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.286317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641d715-d959-4993-a0c2-28797e89841d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.291851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bad8b9-9b81-4afe-a207-d04b30d91b8e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.292933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5aa7b-2673-4512-a387-99ec5887fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.293626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5aa7b-2673-4512-a387-99ec5887fae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.293885 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5aa7b-2673-4512-a387-99ec5887fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.294154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5aa7b-2673-4512-a387-99ec5887fae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.294843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5aa7b-2673-4512-a387-99ec5887fae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.296555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5aa7b-2673-4512-a387-99ec5887fae3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.297307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dd4e7-18e9-4b81-9f26-ee66abf48dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.297923 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dd4e7-18e9-4b81-9f26-ee66abf48dce admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.298203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dd4e7-18e9-4b81-9f26-ee66abf48dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.298476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dd4e7-18e9-4b81-9f26-ee66abf48dce admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.299212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dd4e7-18e9-4b81-9f26-ee66abf48dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:58.299517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dd4e7-18e9-4b81-9f26-ee66abf48dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.301105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dd4e7-18e9-4b81-9f26-ee66abf48dce admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.307130 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 784/1558] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:58.308986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32caa3f-6d9e-4d0a-9957-999eaa8f79d9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.309292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32caa3f-6d9e-4d0a-9957-999eaa8f79d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.309625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32caa3f-6d9e-4d0a-9957-999eaa8f79d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.313491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 775/1559] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:37:58.314612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a87c7-7637-4e15-8333-f6ebf8017816 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.314898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a87c7-7637-4e15-8333-f6ebf8017816 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.315170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a87c7-7637-4e15-8333-f6ebf8017816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.330019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d32caa3f-6d9e-4d0a-9957-999eaa8f79d9 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:58.331215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d32caa3f-6d9e-4d0a-9957-999eaa8f79d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.334173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e11a87c7-7637-4e15-8333-f6ebf8017816 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:58.335332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e11a87c7-7637-4e15-8333-f6ebf8017816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.339939 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 785/1560] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:58.340904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32caa3f-6d9e-4d0a-9957-999eaa8f79d9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.344328 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 776/1561] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:58.348984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c32d9d-8b9b-418b-bff1-9883b5059dc9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.349359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c32d9d-8b9b-418b-bff1-9883b5059dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.349645 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c32d9d-8b9b-418b-bff1-9883b5059dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.352305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32caa3f-6d9e-4d0a-9957-999eaa8f79d9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.359316 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672d048-d9cf-419b-b881-980804bbe8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.359921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d048-d9cf-419b-b881-980804bbe8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.360198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d048-d9cf-419b-b881-980804bbe8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.360471 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d048-d9cf-419b-b881-980804bbe8b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.361401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672d048-d9cf-419b-b881-980804bbe8b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:58.361977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672d048-d9cf-419b-b881-980804bbe8b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.365007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672d048-d9cf-419b-b881-980804bbe8b4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.370648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a2c32d9d-8b9b-418b-bff1-9883b5059dc9 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:58.371946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a2c32d9d-8b9b-418b-bff1-9883b5059dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.380015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 777/1562] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:58.383807 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c32d9d-8b9b-418b-bff1-9883b5059dc9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.383915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 786/1563] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:37:58.383915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25058dfd-8d78-4e17-9553-14ca0113437e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.383915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25058dfd-8d78-4e17-9553-14ca0113437e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.383915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25058dfd-8d78-4e17-9553-14ca0113437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.390394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c32d9d-8b9b-418b-bff1-9883b5059dc9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.395110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca6189-a5cc-4781-911f-699a43c4953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.406316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca6189-a5cc-4781-911f-699a43c4953f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.406316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca6189-a5cc-4781-911f-699a43c4953f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.406316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca6189-a5cc-4781-911f-699a43c4953f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.406316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca6189-a5cc-4781-911f-699a43c4953f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.406316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca6189-a5cc-4781-911f-699a43c4953f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.406781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-25058dfd-8d78-4e17-9553-14ca0113437e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:58.406781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-25058dfd-8d78-4e17-9553-14ca0113437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.411981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 778/1564] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:58.411981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca6189-a5cc-4781-911f-699a43c4953f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.416248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 787/1565] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:58.417083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25058dfd-8d78-4e17-9553-14ca0113437e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.423453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca6189-a5cc-4781-911f-699a43c4953f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.427376 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25058dfd-8d78-4e17-9553-14ca0113437e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.428295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fcb12-36db-4cd0-8f0b-196cf0c975a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.428931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fcb12-36db-4cd0-8f0b-196cf0c975a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.429256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fcb12-36db-4cd0-8f0b-196cf0c975a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.429529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fcb12-36db-4cd0-8f0b-196cf0c975a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.430224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fcb12-36db-4cd0-8f0b-196cf0c975a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.431828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fcb12-36db-4cd0-8f0b-196cf0c975a6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.431940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa7d93-fd02-421c-81d4-5a27abb0e8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.432565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7d93-fd02-421c-81d4-5a27abb0e8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.432882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7d93-fd02-421c-81d4-5a27abb0e8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.433869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7d93-fd02-421c-81d4-5a27abb0e8c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.436254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa7d93-fd02-421c-81d4-5a27abb0e8c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.436472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa7d93-fd02-421c-81d4-5a27abb0e8c9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.442287 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 779/1566] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:58.443492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59327-db22-4226-b74c-250041ec2373 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.443778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59327-db22-4226-b74c-250041ec2373 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.444052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce59327-db22-4226-b74c-250041ec2373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.453623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:58.463374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8ce59327-db22-4226-b74c-250041ec2373 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:58.465390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8ce59327-db22-4226-b74c-250041ec2373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:58.473503 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 780/1567] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:58.474520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce59327-db22-4226-b74c-250041ec2373 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.484437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce59327-db22-4226-b74c-250041ec2373 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.489116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18ef54-7160-4c4d-b0f0-f0a69b2f07aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.493768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ef54-7160-4c4d-b0f0-f0a69b2f07aa admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.493768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ef54-7160-4c4d-b0f0-f0a69b2f07aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.493768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ef54-7160-4c4d-b0f0-f0a69b2f07aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.493768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ef54-7160-4c4d-b0f0-f0a69b2f07aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:58.493768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ef54-7160-4c4d-b0f0-f0a69b2f07aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.493768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ef54-7160-4c4d-b0f0-f0a69b2f07aa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.504767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 781/1568] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:37:58.505780 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18ef54-7160-4c4d-b0f0-f0a69b2f07aa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.517271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18ef54-7160-4c4d-b0f0-f0a69b2f07aa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.522147 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851062b-f78e-4be6-b539-654f3a70b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.522749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851062b-f78e-4be6-b539-654f3a70b196 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.523028 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851062b-f78e-4be6-b539-654f3a70b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.523296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851062b-f78e-4be6-b539-654f3a70b196 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.523978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851062b-f78e-4be6-b539-654f3a70b196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:58.524280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851062b-f78e-4be6-b539-654f3a70b196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.525942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851062b-f78e-4be6-b539-654f3a70b196 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.535463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:58.538841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 782/1569] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:37:58.539924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851062b-f78e-4be6-b539-654f3a70b196 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.549210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 788/1570] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:58.549210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa7d93-fd02-421c-81d4-5a27abb0e8c9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.551221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851062b-f78e-4be6-b539-654f3a70b196 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.606612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff2b66-7e9d-4d90-9c7d-75f1e9ebaeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.607378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff2b66-7e9d-4d90-9c7d-75f1e9ebaeff admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.607540 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff2b66-7e9d-4d90-9c7d-75f1e9ebaeff admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.607820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff2b66-7e9d-4d90-9c7d-75f1e9ebaeff admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.608485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff2b66-7e9d-4d90-9c7d-75f1e9ebaeff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.610483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff2b66-7e9d-4d90-9c7d-75f1e9ebaeff admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.618632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa7d93-fd02-421c-81d4-5a27abb0e8c9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.624104 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d92a89-6bca-4192-b0b7-a3b3aa571bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.625637 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d92a89-6bca-4192-b0b7-a3b3aa571bac admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.625637 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d92a89-6bca-4192-b0b7-a3b3aa571bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.625637 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d92a89-6bca-4192-b0b7-a3b3aa571bac admin admin] PATH_INFO: `/v3/projects/bfd022889b8842abb88809ec34a6f041/users/2501ba114a934051a678f0721f487bc5/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.641247 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d92a89-6bca-4192-b0b7-a3b3aa571bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd022889b8842abb88809ec34a6f041, user_id=2501ba114a934051a678f0721f487bc5, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.642274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-b8d92a89-6bca-4192-b0b7-a3b3aa571bac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:37:58.642274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 28 05:37:58.642274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: Jul 28 05:37:58.647530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d92a89-6bca-4192-b0b7-a3b3aa571bac admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.724648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 783/1571] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:58.725439 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff2b66-7e9d-4d90-9c7d-75f1e9ebaeff admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.746840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 789/1572] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:37:58 2022] PUT /identity/v3/projects/bfd022889b8842abb88809ec34a6f041/users/2501ba114a934051a678f0721f487bc5/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:58.761625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d92a89-6bca-4192-b0b7-a3b3aa571bac admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.790221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff2b66-7e9d-4d90-9c7d-75f1e9ebaeff admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.818120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d92a89-6bca-4192-b0b7-a3b3aa571bac admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.822815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c0d2c-a3b8-46b7-80d0-5eb40a058da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.824084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0d2c-a3b8-46b7-80d0-5eb40a058da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.824362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0d2c-a3b8-46b7-80d0-5eb40a058da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.824796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0d2c-a3b8-46b7-80d0-5eb40a058da9 admin admin] PATH_INFO: `/v3/projects/10e8b9ef3fd546d5b0497b68f4af21a6/users/68338acbeca24792bbcf046711cc3767/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.839435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c0d2c-a3b8-46b7-80d0-5eb40a058da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e8b9ef3fd546d5b0497b68f4af21a6, user_id=68338acbeca24792bbcf046711cc3767, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.842149 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c0d2c-a3b8-46b7-80d0-5eb40a058da9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.846615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c5ad7-4cd4-42a9-ab82-b9d43d7fb858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.847239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c5ad7-4cd4-42a9-ab82-b9d43d7fb858 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.847521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c5ad7-4cd4-42a9-ab82-b9d43d7fb858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.847791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c5ad7-4cd4-42a9-ab82-b9d43d7fb858 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.848482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c5ad7-4cd4-42a9-ab82-b9d43d7fb858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:58.848783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c5ad7-4cd4-42a9-ab82-b9d43d7fb858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.850403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c5ad7-4cd4-42a9-ab82-b9d43d7fb858 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.861468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 784/1573] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:37:58.862249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c5ad7-4cd4-42a9-ab82-b9d43d7fb858 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.872378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c5ad7-4cd4-42a9-ab82-b9d43d7fb858 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.876980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303632f2-6f87-4c1a-a606-d4c1b995b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.877592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303632f2-6f87-4c1a-a606-d4c1b995b7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.877901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303632f2-6f87-4c1a-a606-d4c1b995b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.878185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303632f2-6f87-4c1a-a606-d4c1b995b7b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.878845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303632f2-6f87-4c1a-a606-d4c1b995b7b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:37:58.879144 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303632f2-6f87-4c1a-a606-d4c1b995b7b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.880693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303632f2-6f87-4c1a-a606-d4c1b995b7b5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.889684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 790/1574] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:37:58 2022] PUT /identity/v3/projects/10e8b9ef3fd546d5b0497b68f4af21a6/users/68338acbeca24792bbcf046711cc3767/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:37:58.894600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c0d2c-a3b8-46b7-80d0-5eb40a058da9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.894729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 785/1575] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:37:58.894729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303632f2-6f87-4c1a-a606-d4c1b995b7b5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:58.907585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303632f2-6f87-4c1a-a606-d4c1b995b7b5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.916950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:58.961055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c0d2c-a3b8-46b7-80d0-5eb40a058da9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:58.965747 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce3582-33af-46e4-899e-89a818a593db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.966022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58f44-c22a-4c90-863a-ea255f0bc8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:58.966449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce3582-33af-46e4-899e-89a818a593db admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.966564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58f44-c22a-4c90-863a-ea255f0bc8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:58.966729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce3582-33af-46e4-899e-89a818a593db admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.966826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58f44-c22a-4c90-863a-ea255f0bc8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:58.966999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce3582-33af-46e4-899e-89a818a593db admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.967103 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58f44-c22a-4c90-863a-ea255f0bc8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:58.967662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce3582-33af-46e4-899e-89a818a593db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.967765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed58f44-c22a-4c90-863a-ea255f0bc8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:58.969613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce3582-33af-46e4-899e-89a818a593db admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.969725 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed58f44-c22a-4c90-863a-ea255f0bc8d7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:58.975435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:59.082683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 786/1576] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/projects => generated 389 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:59.083758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce3582-33af-46e4-899e-89a818a593db admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.097148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 791/1577] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:58 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:59.098142 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58f44-c22a-4c90-863a-ea255f0bc8d7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.145335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce3582-33af-46e4-899e-89a818a593db admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.168244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58f44-c22a-4c90-863a-ea255f0bc8d7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.173304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9ad68-0962-4c1d-b5af-e6b07a1ac783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.173974 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9ad68-0962-4c1d-b5af-e6b07a1ac783 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.174257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9ad68-0962-4c1d-b5af-e6b07a1ac783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.174531 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9ad68-0962-4c1d-b5af-e6b07a1ac783 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.175252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9ad68-0962-4c1d-b5af-e6b07a1ac783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.177222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9ad68-0962-4c1d-b5af-e6b07a1ac783 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.205581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154cd3b-7ba8-4c89-9f5d-bd841da26801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.206194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154cd3b-7ba8-4c89-9f5d-bd841da26801 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.206471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154cd3b-7ba8-4c89-9f5d-bd841da26801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.206736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154cd3b-7ba8-4c89-9f5d-bd841da26801 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.207386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154cd3b-7ba8-4c89-9f5d-bd841da26801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.209324 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154cd3b-7ba8-4c89-9f5d-bd841da26801 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.253630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 792/1578] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:59.254934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e808e-ceaf-4d27-93aa-fa6b02678531 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.255286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e808e-ceaf-4d27-93aa-fa6b02678531 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.255630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e808e-ceaf-4d27-93aa-fa6b02678531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.283885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 787/1579] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:59.286720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-953e808e-ceaf-4d27-93aa-fa6b02678531 None None] MFA Rules not processed for user `2501ba114a934051a678f0721f487bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:59.286858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154cd3b-7ba8-4c89-9f5d-bd841da26801 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.286943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-953e808e-ceaf-4d27-93aa-fa6b02678531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:59.294942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154cd3b-7ba8-4c89-9f5d-bd841da26801 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.299729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4faba9-3e3e-45d3-bbad-d0b9c1c74ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.300333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4faba9-3e3e-45d3-bbad-d0b9c1c74ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.300614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4faba9-3e3e-45d3-bbad-d0b9c1c74ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.300891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4faba9-3e3e-45d3-bbad-d0b9c1c74ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.301592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4faba9-3e3e-45d3-bbad-d0b9c1c74ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.303489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4faba9-3e3e-45d3-bbad-d0b9c1c74ec8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.350702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 793/1580] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:59.351612 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e808e-ceaf-4d27-93aa-fa6b02678531 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.362729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e808e-ceaf-4d27-93aa-fa6b02678531 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.367520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f498515-603e-4e35-b6c9-5358a266c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.368137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f498515-603e-4e35-b6c9-5358a266c9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.368412 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f498515-603e-4e35-b6c9-5358a266c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.368682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f498515-603e-4e35-b6c9-5358a266c9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.369379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f498515-603e-4e35-b6c9-5358a266c9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.371839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f498515-603e-4e35-b6c9-5358a266c9b0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.415171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 788/1581] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:59.416381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca63c-30ce-4629-8938-f257378a36f0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.416730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca63c-30ce-4629-8938-f257378a36f0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.417730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ca63c-30ce-4629-8938-f257378a36f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.442059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:59.446745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-407ca63c-30ce-4629-8938-f257378a36f0 None None] MFA Rules not processed for user `68338acbeca24792bbcf046711cc3767`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:37:59.446745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-407ca63c-30ce-4629-8938-f257378a36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:37:59.507620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 794/1582] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:59.508352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f498515-603e-4e35-b6c9-5358a266c9b0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.510850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 789/1583] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:37:59.512156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ca63c-30ce-4629-8938-f257378a36f0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.554119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:37:59.571046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f498515-603e-4e35-b6c9-5358a266c9b0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.574508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ca63c-30ce-4629-8938-f257378a36f0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.575993 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0c17a-4247-4a9b-9b91-8c8b0c0e3e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.576609 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0c17a-4247-4a9b-9b91-8c8b0c0e3e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.576896 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0c17a-4247-4a9b-9b91-8c8b0c0e3e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.577171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0c17a-4247-4a9b-9b91-8c8b0c0e3e0a admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.577834 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0c17a-4247-4a9b-9b91-8c8b0c0e3e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.579342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a6c3a-a5f0-46a0-86f0-9a11f12aeeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.579728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0c17a-4247-4a9b-9b91-8c8b0c0e3e0a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.580005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a6c3a-a5f0-46a0-86f0-9a11f12aeeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.580409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a6c3a-a5f0-46a0-86f0-9a11f12aeeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.580689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a6c3a-a5f0-46a0-86f0-9a11f12aeeb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.581380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a6c3a-a5f0-46a0-86f0-9a11f12aeeb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.583462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a6c3a-a5f0-46a0-86f0-9a11f12aeeb8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.700840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 795/1584] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:59.701686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0c17a-4247-4a9b-9b91-8c8b0c0e3e0a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.710776 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0c17a-4247-4a9b-9b91-8c8b0c0e3e0a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.716401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cfbc2-ac95-4e42-8e12-db21ba8a02a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.716984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cfbc2-ac95-4e42-8e12-db21ba8a02a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.717293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cfbc2-ac95-4e42-8e12-db21ba8a02a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.717564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cfbc2-ac95-4e42-8e12-db21ba8a02a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.718236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cfbc2-ac95-4e42-8e12-db21ba8a02a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.719812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cfbc2-ac95-4e42-8e12-db21ba8a02a9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.730385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 790/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:59.730385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a6c3a-a5f0-46a0-86f0-9a11f12aeeb8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.736910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 796/1586] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:59.736910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cfbc2-ac95-4e42-8e12-db21ba8a02a9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.741054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a6c3a-a5f0-46a0-86f0-9a11f12aeeb8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.746681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62ca72-bf4f-438c-a58a-19c8e37940c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.747300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ca72-bf4f-438c-a58a-19c8e37940c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.747583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ca72-bf4f-438c-a58a-19c8e37940c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.747853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ca72-bf4f-438c-a58a-19c8e37940c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.748543 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62ca72-bf4f-438c-a58a-19c8e37940c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.750192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62ca72-bf4f-438c-a58a-19c8e37940c2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.760669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 791/1587] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:37:59.761572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62ca72-bf4f-438c-a58a-19c8e37940c2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.773321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62ca72-bf4f-438c-a58a-19c8e37940c2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.778993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012bb8a-547d-424d-9db9-487c977a0be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.779595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012bb8a-547d-424d-9db9-487c977a0be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.779875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012bb8a-547d-424d-9db9-487c977a0be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.780149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012bb8a-547d-424d-9db9-487c977a0be0 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.780806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012bb8a-547d-424d-9db9-487c977a0be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.782739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012bb8a-547d-424d-9db9-487c977a0be0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.789763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cfbc2-ac95-4e42-8e12-db21ba8a02a9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.794512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d42f19-0ab3-4dd3-a307-e73708ae74d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.795131 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d42f19-0ab3-4dd3-a307-e73708ae74d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.795405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d42f19-0ab3-4dd3-a307-e73708ae74d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.795676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d42f19-0ab3-4dd3-a307-e73708ae74d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.851668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d42f19-0ab3-4dd3-a307-e73708ae74d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.853099 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d42f19-0ab3-4dd3-a307-e73708ae74d6 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.862195 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 792/1588] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:59.862895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 797/1589] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:37:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:37:59.866620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012bb8a-547d-424d-9db9-487c977a0be0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.866758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d42f19-0ab3-4dd3-a307-e73708ae74d6 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:37:59.875847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d42f19-0ab3-4dd3-a307-e73708ae74d6 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.876330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012bb8a-547d-424d-9db9-487c977a0be0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:37:59.880733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c382f-7d42-4d7e-a5f1-e165656a5b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.880950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8435e-bf4f-4315-b22c-5b626a748199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:37:59.881364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c382f-7d42-4d7e-a5f1-e165656a5b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.881597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8435e-bf4f-4315-b22c-5b626a748199 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:37:59.881719 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c382f-7d42-4d7e-a5f1-e165656a5b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.881871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8435e-bf4f-4315-b22c-5b626a748199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:37:59.881987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c382f-7d42-4d7e-a5f1-e165656a5b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.882130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8435e-bf4f-4315-b22c-5b626a748199 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:37:59.882541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c382f-7d42-4d7e-a5f1-e165656a5b0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.882779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8435e-bf4f-4315-b22c-5b626a748199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:37:59.884416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c382f-7d42-4d7e-a5f1-e165656a5b0f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.884672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8435e-bf4f-4315-b22c-5b626a748199 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:37:59.992313 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 793/1590] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:37:59.993194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8435e-bf4f-4315-b22c-5b626a748199 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.004041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8435e-bf4f-4315-b22c-5b626a748199 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.009842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 798/1591] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:37:59 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:00.009842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c382f-7d42-4d7e-a5f1-e165656a5b0f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.013192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96455a3c-923e-4314-a4c6-18ed0319355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.015078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455a3c-923e-4314-a4c6-18ed0319355d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.015473 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455a3c-923e-4314-a4c6-18ed0319355d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.015809 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455a3c-923e-4314-a4c6-18ed0319355d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.016596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96455a3c-923e-4314-a4c6-18ed0319355d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.018296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96455a3c-923e-4314-a4c6-18ed0319355d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.032793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 794/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.032793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96455a3c-923e-4314-a4c6-18ed0319355d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.043562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96455a3c-923e-4314-a4c6-18ed0319355d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.078361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:00.081486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:00.085053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c382f-7d42-4d7e-a5f1-e165656a5b0f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.091166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4958b8-b5ea-4d15-b6b4-b21642d6a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.091858 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4958b8-b5ea-4d15-b6b4-b21642d6a1eb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.092479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4958b8-b5ea-4d15-b6b4-b21642d6a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.092764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4958b8-b5ea-4d15-b6b4-b21642d6a1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.093665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4958b8-b5ea-4d15-b6b4-b21642d6a1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.095282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4958b8-b5ea-4d15-b6b4-b21642d6a1eb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.109860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 799/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.109860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4958b8-b5ea-4d15-b6b4-b21642d6a1eb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.110134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d7714-adb6-41e7-983a-89f2d7734a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.110645 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d7714-adb6-41e7-983a-89f2d7734a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.110755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d7714-adb6-41e7-983a-89f2d7734a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.110995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d7714-adb6-41e7-983a-89f2d7734a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.111696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d7714-adb6-41e7-983a-89f2d7734a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.113321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d7714-adb6-41e7-983a-89f2d7734a28 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.117654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4958b8-b5ea-4d15-b6b4-b21642d6a1eb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.124459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56719-6034-4396-a910-6be9721a1538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.128022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 795/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.128155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56719-6034-4396-a910-6be9721a1538 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.128254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d7714-adb6-41e7-983a-89f2d7734a28 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.128361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56719-6034-4396-a910-6be9721a1538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.128361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56719-6034-4396-a910-6be9721a1538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.128361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c56719-6034-4396-a910-6be9721a1538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.128765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c56719-6034-4396-a910-6be9721a1538 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.137689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d7714-adb6-41e7-983a-89f2d7734a28 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.140035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 800/1595] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.140841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56719-6034-4396-a910-6be9721a1538 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.143849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6449d-aee2-421c-a48d-a577db945726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.144497 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6449d-aee2-421c-a48d-a577db945726 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.144776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6449d-aee2-421c-a48d-a577db945726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.145048 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6449d-aee2-421c-a48d-a577db945726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.145788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6449d-aee2-421c-a48d-a577db945726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.147449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6449d-aee2-421c-a48d-a577db945726 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.150533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56719-6034-4396-a910-6be9721a1538 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.157319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b49f94-1225-43e5-ae92-495146d255c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.157319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b49f94-1225-43e5-ae92-495146d255c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.157319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b49f94-1225-43e5-ae92-495146d255c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.157630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b49f94-1225-43e5-ae92-495146d255c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.158078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 796/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.158198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b49f94-1225-43e5-ae92-495146d255c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.158867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6449d-aee2-421c-a48d-a577db945726 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.159789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b49f94-1225-43e5-ae92-495146d255c9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.171016 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6449d-aee2-421c-a48d-a577db945726 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.171302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 801/1597] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.172365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b49f94-1225-43e5-ae92-495146d255c9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.176617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de4fbb-a0f7-4e65-b35a-a1fb73be63e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.177272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de4fbb-a0f7-4e65-b35a-a1fb73be63e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.177765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de4fbb-a0f7-4e65-b35a-a1fb73be63e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.178041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de4fbb-a0f7-4e65-b35a-a1fb73be63e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.178710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de4fbb-a0f7-4e65-b35a-a1fb73be63e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.180660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de4fbb-a0f7-4e65-b35a-a1fb73be63e9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.182389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b49f94-1225-43e5-ae92-495146d255c9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.187169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d1cc7-5680-4587-96b0-5d17e748132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.187761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1cc7-5680-4587-96b0-5d17e748132c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.188039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1cc7-5680-4587-96b0-5d17e748132c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.188310 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1cc7-5680-4587-96b0-5d17e748132c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.188989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d1cc7-5680-4587-96b0-5d17e748132c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.190615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d1cc7-5680-4587-96b0-5d17e748132c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.204713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 802/1598] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.204713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d1cc7-5680-4587-96b0-5d17e748132c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.211516 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d1cc7-5680-4587-96b0-5d17e748132c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.217404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc45e99-35c1-438c-838c-4260a9d9db77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.218103 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc45e99-35c1-438c-838c-4260a9d9db77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.218388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc45e99-35c1-438c-838c-4260a9d9db77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.218665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc45e99-35c1-438c-838c-4260a9d9db77 admin admin] PATH_INFO: `/v3/projects/61a1594cca114a7e870990609b5e0d55/users/e8e820139b4448ed9b29e97fb0ecef7e/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.234510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc45e99-35c1-438c-838c-4260a9d9db77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a1594cca114a7e870990609b5e0d55, user_id=e8e820139b4448ed9b29e97fb0ecef7e, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.237241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc45e99-35c1-438c-838c-4260a9d9db77 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.267055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 797/1599] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:00 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:00.267919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de4fbb-a0f7-4e65-b35a-a1fb73be63e9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.278219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de4fbb-a0f7-4e65-b35a-a1fb73be63e9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.282773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5253f12-7502-4cf1-8468-0237b9edd82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.283363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5253f12-7502-4cf1-8468-0237b9edd82e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.283645 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5253f12-7502-4cf1-8468-0237b9edd82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.283915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5253f12-7502-4cf1-8468-0237b9edd82e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.284594 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5253f12-7502-4cf1-8468-0237b9edd82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.286208 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5253f12-7502-4cf1-8468-0237b9edd82e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.296856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 798/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.297642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5253f12-7502-4cf1-8468-0237b9edd82e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.306893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5253f12-7502-4cf1-8468-0237b9edd82e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.312271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde77d-b68e-421f-b11f-fbbc20ba52a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.312892 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde77d-b68e-421f-b11f-fbbc20ba52a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.313205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde77d-b68e-421f-b11f-fbbc20ba52a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.313479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde77d-b68e-421f-b11f-fbbc20ba52a3 admin admin] PATH_INFO: `/v3/projects/e02ec0c5f32b4d1689660c67cb8de41f/users/e728ae311b604bbcaf41f91562bffbc3/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.329122 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebde77d-b68e-421f-b11f-fbbc20ba52a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02ec0c5f32b4d1689660c67cb8de41f, user_id=e728ae311b604bbcaf41f91562bffbc3, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.331805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebde77d-b68e-421f-b11f-fbbc20ba52a3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.346760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 803/1601] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:00 2022] PUT /identity/v3/projects/61a1594cca114a7e870990609b5e0d55/users/e8e820139b4448ed9b29e97fb0ecef7e/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:00.347736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc45e99-35c1-438c-838c-4260a9d9db77 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.414547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc45e99-35c1-438c-838c-4260a9d9db77 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.419961 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff5e21-8ce2-46f9-b421-ad19f36739ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.420570 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff5e21-8ce2-46f9-b421-ad19f36739ae admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.420853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff5e21-8ce2-46f9-b421-ad19f36739ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.421124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff5e21-8ce2-46f9-b421-ad19f36739ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.421829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff5e21-8ce2-46f9-b421-ad19f36739ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.423451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff5e21-8ce2-46f9-b421-ad19f36739ae admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.435802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 799/1602] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:00 2022] PUT /identity/v3/projects/e02ec0c5f32b4d1689660c67cb8de41f/users/e728ae311b604bbcaf41f91562bffbc3/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:00.435802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde77d-b68e-421f-b11f-fbbc20ba52a3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.436108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 804/1603] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.436108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff5e21-8ce2-46f9-b421-ad19f36739ae admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.446732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff5e21-8ce2-46f9-b421-ad19f36739ae admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.500586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde77d-b68e-421f-b11f-fbbc20ba52a3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.505224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca28cf-68ac-4dc5-9797-0dbbc6ca8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.505409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca63b48-2caa-45ce-92f4-95b5cd24f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.505842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca28cf-68ac-4dc5-9797-0dbbc6ca8e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.506049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca63b48-2caa-45ce-92f4-95b5cd24f1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.506152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca28cf-68ac-4dc5-9797-0dbbc6ca8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.506307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca63b48-2caa-45ce-92f4-95b5cd24f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.506413 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca28cf-68ac-4dc5-9797-0dbbc6ca8e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.506563 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca63b48-2caa-45ce-92f4-95b5cd24f1aa admin admin] PATH_INFO: `/v3/projects/1a87ef43f3fa49898368e4fd749bda21/users/9b14f38f371b405f915a7a9ba8c61569/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.507036 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca28cf-68ac-4dc5-9797-0dbbc6ca8e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.508767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca28cf-68ac-4dc5-9797-0dbbc6ca8e7d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.519435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 800/1604] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.520221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca28cf-68ac-4dc5-9797-0dbbc6ca8e7d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.526882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca63b48-2caa-45ce-92f4-95b5cd24f1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a87ef43f3fa49898368e4fd749bda21, user_id=9b14f38f371b405f915a7a9ba8c61569, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.529975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca63b48-2caa-45ce-92f4-95b5cd24f1aa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.531003 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca28cf-68ac-4dc5-9797-0dbbc6ca8e7d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.536126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840087f-b57e-4de5-ba7b-1596f8734266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.536732 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840087f-b57e-4de5-ba7b-1596f8734266 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.537027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840087f-b57e-4de5-ba7b-1596f8734266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.537576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840087f-b57e-4de5-ba7b-1596f8734266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.538379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840087f-b57e-4de5-ba7b-1596f8734266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.540059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840087f-b57e-4de5-ba7b-1596f8734266 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.551492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 801/1605] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:00.552338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840087f-b57e-4de5-ba7b-1596f8734266 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.564105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840087f-b57e-4de5-ba7b-1596f8734266 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.568849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67909f56-5308-4ef5-a775-e7b4caef9c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.591993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909f56-5308-4ef5-a775-e7b4caef9c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.591993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909f56-5308-4ef5-a775-e7b4caef9c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.591993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909f56-5308-4ef5-a775-e7b4caef9c92 admin admin] PATH_INFO: `/v3/projects/e42d3ec831cc431f86382eb815cf1a4f/users/201d18f1d49f4f4b9f124d31ed430b25/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.591993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67909f56-5308-4ef5-a775-e7b4caef9c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42d3ec831cc431f86382eb815cf1a4f, user_id=201d18f1d49f4f4b9f124d31ed430b25, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.591993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67909f56-5308-4ef5-a775-e7b4caef9c92 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.632078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 805/1606] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:00 2022] PUT /identity/v3/projects/1a87ef43f3fa49898368e4fd749bda21/users/9b14f38f371b405f915a7a9ba8c61569/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:00.633359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f00b-8f9e-455d-8982-b79bbe575a3d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.633641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f00b-8f9e-455d-8982-b79bbe575a3d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.634035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f00b-8f9e-455d-8982-b79bbe575a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.656239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 802/1607] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:00 2022] PUT /identity/v3/projects/e42d3ec831cc431f86382eb815cf1a4f/users/201d18f1d49f4f4b9f124d31ed430b25/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:00.657756 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479cd4-1add-4e5e-bbba-35024f89cc1f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.661277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479cd4-1add-4e5e-bbba-35024f89cc1f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.661277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479cd4-1add-4e5e-bbba-35024f89cc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.661486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:00.663264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e878f00b-8f9e-455d-8982-b79bbe575a3d None None] MFA Rules not processed for user `e8e820139b4448ed9b29e97fb0ecef7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:00.664515 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e878f00b-8f9e-455d-8982-b79bbe575a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:00.690308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9a479cd4-1add-4e5e-bbba-35024f89cc1f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:00.691494 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a479cd4-1add-4e5e-bbba-35024f89cc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:00.716513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:00.738347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 806/1608] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:00.739189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878f00b-8f9e-455d-8982-b79bbe575a3d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.753597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 803/1609] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:00.755010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a479cd4-1add-4e5e-bbba-35024f89cc1f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.767528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a479cd4-1add-4e5e-bbba-35024f89cc1f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.773637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a75f0-8c55-4122-a0c6-4c5f752d1d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.776282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a75f0-8c55-4122-a0c6-4c5f752d1d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.776282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a75f0-8c55-4122-a0c6-4c5f752d1d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.776282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a75f0-8c55-4122-a0c6-4c5f752d1d10 admin admin] PATH_INFO: `/v3/projects/2df70afd2478469d8ae2fdad0d84de6b/users/a3c7e6f82acd45488412439dccb933f2/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.792784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a75f0-8c55-4122-a0c6-4c5f752d1d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df70afd2478469d8ae2fdad0d84de6b, user_id=a3c7e6f82acd45488412439dccb933f2, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.795917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a75f0-8c55-4122-a0c6-4c5f752d1d10 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.824743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878f00b-8f9e-455d-8982-b79bbe575a3d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.829710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc4941-0099-4e8f-ad0a-41eb88dfe48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:00.830453 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4941-0099-4e8f-ad0a-41eb88dfe48f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.830802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4941-0099-4e8f-ad0a-41eb88dfe48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.831243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4941-0099-4e8f-ad0a-41eb88dfe48f admin admin] PATH_INFO: `/v3/projects/87ff893dfd7f43b8bbca71ea23907860/users/69a74a81980947d9a2499a4d9ad65823/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.848327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc4941-0099-4e8f-ad0a-41eb88dfe48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ff893dfd7f43b8bbca71ea23907860, user_id=69a74a81980947d9a2499a4d9ad65823, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:00.851101 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc4941-0099-4e8f-ad0a-41eb88dfe48f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:00.893938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 804/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:00 2022] PUT /identity/v3/projects/2df70afd2478469d8ae2fdad0d84de6b/users/a3c7e6f82acd45488412439dccb933f2/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:00.894812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a75f0-8c55-4122-a0c6-4c5f752d1d10 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:00.954317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 807/1611] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:00 2022] PUT /identity/v3/projects/87ff893dfd7f43b8bbca71ea23907860/users/69a74a81980947d9a2499a4d9ad65823/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:00.955615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6a45-f7a1-4524-9f9c-56f3f0db46dc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:00.955904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6a45-f7a1-4524-9f9c-56f3f0db46dc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:00.956175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6a45-f7a1-4524-9f9c-56f3f0db46dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:00.960782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a75f0-8c55-4122-a0c6-4c5f752d1d10 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:00.978354 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0a7d6a45-f7a1-4524-9f9c-56f3f0db46dc None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:00.980696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a7d6a45-f7a1-4524-9f9c-56f3f0db46dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:01.049948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 808/1612] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:01.050330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15611a-c1d8-4314-af94-91bcdea4f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.051090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743d9a-f8f4-4ae8-a7f4-e1bfb5122871 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.051204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15611a-c1d8-4314-af94-91bcdea4f04f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.051420 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743d9a-f8f4-4ae8-a7f4-e1bfb5122871 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.051547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15611a-c1d8-4314-af94-91bcdea4f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.051705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743d9a-f8f4-4ae8-a7f4-e1bfb5122871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.052172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15611a-c1d8-4314-af94-91bcdea4f04f admin admin] PATH_INFO: `/v3/projects/0d9caa5e82c541abba80208f603f9b21/users/4a600bf1c35e4c09b5345c4dd4c0666f/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.068733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15611a-c1d8-4314-af94-91bcdea4f04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9caa5e82c541abba80208f603f9b21, user_id=4a600bf1c35e4c09b5345c4dd4c0666f, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.071479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15611a-c1d8-4314-af94-91bcdea4f04f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.083736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b9743d9a-f8f4-4ae8-a7f4-e1bfb5122871 None None] MFA Rules not processed for user `201d18f1d49f4f4b9f124d31ed430b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:01.084943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b9743d9a-f8f4-4ae8-a7f4-e1bfb5122871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:01.098775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:01.149869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 809/1613] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:01.150676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9743d9a-f8f4-4ae8-a7f4-e1bfb5122871 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.160901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9743d9a-f8f4-4ae8-a7f4-e1bfb5122871 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.166028 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 805/1614] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:00 2022] PUT /identity/v3/projects/0d9caa5e82c541abba80208f603f9b21/users/4a600bf1c35e4c09b5345c4dd4c0666f/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:01.166978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15611a-c1d8-4314-af94-91bcdea4f04f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.174782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a15611a-c1d8-4314-af94-91bcdea4f04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:01.223477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:01.227848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dfb15-d0ed-4304-9962-12d4f06d8a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.228472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfb15-d0ed-4304-9962-12d4f06d8a7f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.228750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfb15-d0ed-4304-9962-12d4f06d8a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.229015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfb15-d0ed-4304-9962-12d4f06d8a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.230165 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dfb15-d0ed-4304-9962-12d4f06d8a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.232109 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dfb15-d0ed-4304-9962-12d4f06d8a7f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.240158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15611a-c1d8-4314-af94-91bcdea4f04f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.244359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92f70b-b1b0-4b61-b473-2842a101bba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.244739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92f70b-b1b0-4b61-b473-2842a101bba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.245610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92f70b-b1b0-4b61-b473-2842a101bba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.245910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92f70b-b1b0-4b61-b473-2842a101bba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.255113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92f70b-b1b0-4b61-b473-2842a101bba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.256563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92f70b-b1b0-4b61-b473-2842a101bba8 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.267265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 806/1615] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:01.268584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837771e5-9aca-4752-9657-0e0aadedd18c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.268867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837771e5-9aca-4752-9657-0e0aadedd18c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.269155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837771e5-9aca-4752-9657-0e0aadedd18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.290326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-837771e5-9aca-4752-9657-0e0aadedd18c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:01.290326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-837771e5-9aca-4752-9657-0e0aadedd18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:01.298235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 807/1616] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:01.299496 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ff740-683d-4947-a8cc-653c965259f9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.299779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ff740-683d-4947-a8cc-653c965259f9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.300047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ff740-683d-4947-a8cc-653c965259f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.315037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 810/1617] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:01 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:01.315879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dfb15-d0ed-4304-9962-12d4f06d8a7f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.321809 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cf8ff740-683d-4947-a8cc-653c965259f9 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:01.324063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cf8ff740-683d-4947-a8cc-653c965259f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:01.378920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dfb15-d0ed-4304-9962-12d4f06d8a7f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.383125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18434a3-3f5a-42f3-8cd3-00c2df1fee35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.383756 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18434a3-3f5a-42f3-8cd3-00c2df1fee35 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.384022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18434a3-3f5a-42f3-8cd3-00c2df1fee35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.384926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18434a3-3f5a-42f3-8cd3-00c2df1fee35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.398523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 808/1618] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:01.398523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ff740-683d-4947-a8cc-653c965259f9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.415472 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ff740-683d-4947-a8cc-653c965259f9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.420753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6098c-fc6e-47a2-be69-20ce6b6a468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.421526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6098c-fc6e-47a2-be69-20ce6b6a468e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.422034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6098c-fc6e-47a2-be69-20ce6b6a468e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.423790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6098c-fc6e-47a2-be69-20ce6b6a468e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.424502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6098c-fc6e-47a2-be69-20ce6b6a468e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.426607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6098c-fc6e-47a2-be69-20ce6b6a468e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.440035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 809/1619] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:01.442020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e728-1e5b-4f55-aad8-3d1e096f90d3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.442778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e728-1e5b-4f55-aad8-3d1e096f90d3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.443725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e728-1e5b-4f55-aad8-3d1e096f90d3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.445655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 810/1620] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 05:38:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:38:01.446690 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2e728-1e5b-4f55-aad8-3d1e096f90d3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.457357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:01.460008 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2e728-1e5b-4f55-aad8-3d1e096f90d3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.463691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00157dee-6735-4a15-86d4-e2039c604fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.464680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00157dee-6735-4a15-86d4-e2039c604fba service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.464988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00157dee-6735-4a15-86d4-e2039c604fba service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.465295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00157dee-6735-4a15-86d4-e2039c604fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.467179 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18434a3-3f5a-42f3-8cd3-00c2df1fee35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.468619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18434a3-3f5a-42f3-8cd3-00c2df1fee35 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.474408 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00157dee-6735-4a15-86d4-e2039c604fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.475878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00157dee-6735-4a15-86d4-e2039c604fba service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.478275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 811/1621] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:01.482095 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18434a3-3f5a-42f3-8cd3-00c2df1fee35 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.487459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 811/1622] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:01.488289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00157dee-6735-4a15-86d4-e2039c604fba service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.489001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18434a3-3f5a-42f3-8cd3-00c2df1fee35 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.494676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a20dc9-5da0-4a6c-b95c-6e6bbdf0ef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.496012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a20dc9-5da0-4a6c-b95c-6e6bbdf0ef61 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.496373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a20dc9-5da0-4a6c-b95c-6e6bbdf0ef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.496764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a20dc9-5da0-4a6c-b95c-6e6bbdf0ef61 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.497225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00157dee-6735-4a15-86d4-e2039c604fba service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.497681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a20dc9-5da0-4a6c-b95c-6e6bbdf0ef61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.499747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a20dc9-5da0-4a6c-b95c-6e6bbdf0ef61 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.501596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca1373-97d9-4d38-814c-b5951b746d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.502230 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1373-97d9-4d38-814c-b5951b746d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.502508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1373-97d9-4d38-814c-b5951b746d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.502778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1373-97d9-4d38-814c-b5951b746d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.514537 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca1373-97d9-4d38-814c-b5951b746d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.516201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca1373-97d9-4d38-814c-b5951b746d9f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.526476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 812/1623] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:01.527776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca1373-97d9-4d38-814c-b5951b746d9f service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.536699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca1373-97d9-4d38-814c-b5951b746d9f service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.544856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c29c-69e5-4a71-bdfc-465f50fc6db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.545596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c29c-69e5-4a71-bdfc-465f50fc6db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.546059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c29c-69e5-4a71-bdfc-465f50fc6db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.546249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c29c-69e5-4a71-bdfc-465f50fc6db3 admin admin] PATH_INFO: `/v3/projects/0d9caa5e82c541abba80208f603f9b21/users/4a600bf1c35e4c09b5345c4dd4c0666f/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.551017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083c29c-69e5-4a71-bdfc-465f50fc6db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9caa5e82c541abba80208f603f9b21, user_id=4a600bf1c35e4c09b5345c4dd4c0666f, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.553353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083c29c-69e5-4a71-bdfc-465f50fc6db3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.565372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 813/1624] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:01 2022] PUT /identity/v3/projects/0d9caa5e82c541abba80208f603f9b21/users/4a600bf1c35e4c09b5345c4dd4c0666f/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:01.566648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170953-452a-423b-b21d-b2c450a34ec6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.567068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170953-452a-423b-b21d-b2c450a34ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.567351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170953-452a-423b-b21d-b2c450a34ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.606539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f0170953-452a-423b-b21d-b2c450a34ec6 None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:01.607964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f0170953-452a-423b-b21d-b2c450a34ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:01.638359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 812/1625] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:01 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:01.639980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ace3-133b-4d9f-a4fe-285f2d87bb6e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.640659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ace3-133b-4d9f-a4fe-285f2d87bb6e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.641008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ace3-133b-4d9f-a4fe-285f2d87bb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.679546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0fa4ace3-133b-4d9f-a4fe-285f2d87bb6e None None] MFA Rules not processed for user `4a600bf1c35e4c09b5345c4dd4c0666f`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:01.688476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0fa4ace3-133b-4d9f-a4fe-285f2d87bb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:01.704586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 814/1626] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 05:38:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:01.705651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0170953-452a-423b-b21d-b2c450a34ec6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.747303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:01.768275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 813/1627] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:01 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:01.776425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4ace3-133b-4d9f-a4fe-285f2d87bb6e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.784924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4ace3-133b-4d9f-a4fe-285f2d87bb6e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.785177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0170953-452a-423b-b21d-b2c450a34ec6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.790801 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ffcc5-081c-4160-8d12-2dc4fed95268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.791438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ffcc5-081c-4160-8d12-2dc4fed95268 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.792394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ffcc5-081c-4160-8d12-2dc4fed95268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.792692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ffcc5-081c-4160-8d12-2dc4fed95268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.793432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ffcc5-081c-4160-8d12-2dc4fed95268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.795025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d164b-8e57-4d0d-8fa7-e2e719ba7027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.795156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ffcc5-081c-4160-8d12-2dc4fed95268 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.795994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d164b-8e57-4d0d-8fa7-e2e719ba7027 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.796493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d164b-8e57-4d0d-8fa7-e2e719ba7027 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.796975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d164b-8e57-4d0d-8fa7-e2e719ba7027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.805922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 815/1628] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:01.806875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ffcc5-081c-4160-8d12-2dc4fed95268 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.871512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d164b-8e57-4d0d-8fa7-e2e719ba7027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.874079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d164b-8e57-4d0d-8fa7-e2e719ba7027 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.889414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 814/1629] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:01.900643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d164b-8e57-4d0d-8fa7-e2e719ba7027 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:01.924133 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ffcc5-081c-4160-8d12-2dc4fed95268 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.925824 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d164b-8e57-4d0d-8fa7-e2e719ba7027 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:01.938055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699c079-ba7b-4575-bf8a-7a51be376f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.938763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699c079-ba7b-4575-bf8a-7a51be376f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.939110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf604-5aee-43fc-ba66-96043495e019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:01.940237 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf604-5aee-43fc-ba66-96043495e019 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:01.940438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699c079-ba7b-4575-bf8a-7a51be376f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.940754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699c079-ba7b-4575-bf8a-7a51be376f8b admin admin] PATH_INFO: `/v3/projects/6f48e29bafad4683bafc184a23a3559b/users/bfaf6f93dd1f49819044dc978872f4f9/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.942975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf604-5aee-43fc-ba66-96043495e019 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:01.943370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf604-5aee-43fc-ba66-96043495e019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:01.964954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebf604-5aee-43fc-ba66-96043495e019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.971239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebf604-5aee-43fc-ba66-96043495e019 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:01.985358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699c079-ba7b-4575-bf8a-7a51be376f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f48e29bafad4683bafc184a23a3559b, user_id=bfaf6f93dd1f49819044dc978872f4f9, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:01.985358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699c079-ba7b-4575-bf8a-7a51be376f8b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:02.003411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 816/1630] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:02.068184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 815/1631] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:01 2022] PUT /identity/v3/projects/6f48e29bafad4683bafc184a23a3559b/users/bfaf6f93dd1f49819044dc978872f4f9/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:02.073820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf604-5aee-43fc-ba66-96043495e019 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:02.086071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf604-5aee-43fc-ba66-96043495e019 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:02.180369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019b9f2-a68a-4aa2-b06a-c7ea4a3a87dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:02.184618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019b9f2-a68a-4aa2-b06a-c7ea4a3a87dc admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.184618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019b9f2-a68a-4aa2-b06a-c7ea4a3a87dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.184618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019b9f2-a68a-4aa2-b06a-c7ea4a3a87dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.184618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019b9f2-a68a-4aa2-b06a-c7ea4a3a87dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:02.186713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019b9f2-a68a-4aa2-b06a-c7ea4a3a87dc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:02.207471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 817/1632] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:02.207939 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699c079-ba7b-4575-bf8a-7a51be376f8b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:02.220667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699c079-ba7b-4575-bf8a-7a51be376f8b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:02.237796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc92fb-9b7f-4bc4-9e1f-8a19269ab152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:02.238554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc92fb-9b7f-4bc4-9e1f-8a19269ab152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.238837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc92fb-9b7f-4bc4-9e1f-8a19269ab152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.239108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc92fb-9b7f-4bc4-9e1f-8a19269ab152 admin admin] PATH_INFO: `/v3/projects/6f48e29bafad4683bafc184a23a3559b/users/bfaf6f93dd1f49819044dc978872f4f9/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.241278 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc92fb-9b7f-4bc4-9e1f-8a19269ab152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f48e29bafad4683bafc184a23a3559b, user_id=bfaf6f93dd1f49819044dc978872f4f9, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:02.248121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc92fb-9b7f-4bc4-9e1f-8a19269ab152 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:02.284523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 816/1633] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:02 2022] PUT /identity/v3/projects/6f48e29bafad4683bafc184a23a3559b/users/bfaf6f93dd1f49819044dc978872f4f9/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:02.287749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c4d0-7903-4a59-9d31-9103f46d2896 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.288554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c4d0-7903-4a59-9d31-9103f46d2896 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.288933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c4d0-7903-4a59-9d31-9103f46d2896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.310033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7662f7-c05a-401e-9e6b-47a58ae07fc8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.310448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7662f7-c05a-401e-9e6b-47a58ae07fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.310659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7662f7-c05a-401e-9e6b-47a58ae07fc8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.312002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 817/1634] 10.222.0.42 () {54 vars in 912 bytes} [Thu Jul 28 05:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:38:02.317655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b391118-d75a-484d-8de3-8f29582aebaf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.317937 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b391118-d75a-484d-8de3-8f29582aebaf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.318199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b391118-d75a-484d-8de3-8f29582aebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.338071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1131c4d0-7903-4a59-9d31-9103f46d2896 None None] MFA Rules not processed for user `bfaf6f93dd1f49819044dc978872f4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:02.339873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1131c4d0-7903-4a59-9d31-9103f46d2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:02.340366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0b391118-d75a-484d-8de3-8f29582aebaf None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:02.341703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0b391118-d75a-484d-8de3-8f29582aebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:02.361843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:02.402353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:02.460224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 818/1635] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:38:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:02.465746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb8f1e-7269-416f-99ba-be71ecfd6935 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.465746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb8f1e-7269-416f-99ba-be71ecfd6935 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.465746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb8f1e-7269-416f-99ba-be71ecfd6935 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.473948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 819/1636] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 05:38:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:38:02.475425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1a219-62cb-4b2e-9b1f-bd1a798d290f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.475875 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1a219-62cb-4b2e-9b1f-bd1a798d290f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.476276 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1a219-62cb-4b2e-9b1f-bd1a798d290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.499499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6ed1a219-62cb-4b2e-9b1f-bd1a798d290f None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:02.504065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 818/1637] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:02.504207 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6ed1a219-62cb-4b2e-9b1f-bd1a798d290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:02.504326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131c4d0-7903-4a59-9d31-9103f46d2896 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:02.518019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 820/1638] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 05:38:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:02.519550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b175e5e-407b-4601-b53f-8968a3965f05 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.519940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b175e5e-407b-4601-b53f-8968a3965f05 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.520321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b175e5e-407b-4601-b53f-8968a3965f05 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.522012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 821/1639] 10.222.0.42 () {54 vars in 912 bytes} [Thu Jul 28 05:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:38:02.528137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a74fd-5d4d-450c-8a99-e9be85086c64 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.529041 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a74fd-5d4d-450c-8a99-e9be85086c64 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.529041 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a74fd-5d4d-450c-8a99-e9be85086c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.561719 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-935a74fd-5d4d-450c-8a99-e9be85086c64 None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:02.564886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-935a74fd-5d4d-450c-8a99-e9be85086c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:02.590923 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131c4d0-7903-4a59-9d31-9103f46d2896 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:02.594832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78d0e9-984c-4c8d-a7d1-b4a87fb3a592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:02.595610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78d0e9-984c-4c8d-a7d1-b4a87fb3a592 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.596231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78d0e9-984c-4c8d-a7d1-b4a87fb3a592 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.596578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78d0e9-984c-4c8d-a7d1-b4a87fb3a592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.596829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 822/1640] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:38:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:02.612296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a74fd-5d4d-450c-8a99-e9be85086c64 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:02.626582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a74fd-5d4d-450c-8a99-e9be85086c64 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:02.630097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78d0e9-984c-4c8d-a7d1-b4a87fb3a592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:02.630590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c268b-02f7-401c-a3fa-093039fc6991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:02.631383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c268b-02f7-401c-a3fa-093039fc6991 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.631579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78d0e9-984c-4c8d-a7d1-b4a87fb3a592 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:02.631694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c268b-02f7-401c-a3fa-093039fc6991 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.632216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c268b-02f7-401c-a3fa-093039fc6991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.647268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c268b-02f7-401c-a3fa-093039fc6991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:02.649974 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c268b-02f7-401c-a3fa-093039fc6991 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:02.653381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 819/1641] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:02.675855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 823/1642] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:02.722868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78d0e9-984c-4c8d-a7d1-b4a87fb3a592 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:02.737303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78d0e9-984c-4c8d-a7d1-b4a87fb3a592 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:02.742761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427a512-7e93-425a-9c19-a85c0717ec54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:02.743456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427a512-7e93-425a-9c19-a85c0717ec54 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:02.743752 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427a512-7e93-425a-9c19-a85c0717ec54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:02.744029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427a512-7e93-425a-9c19-a85c0717ec54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:02.778986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427a512-7e93-425a-9c19-a85c0717ec54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:02.781808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427a512-7e93-425a-9c19-a85c0717ec54 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:02.797760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 820/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:03.433541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c268b-02f7-401c-a3fa-093039fc6991 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:03.433541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c268b-02f7-401c-a3fa-093039fc6991 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:03.433541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:03.433541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:03.435759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:03.435759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] PATH_INFO: `/v3/users/201d18f1d49f4f4b9f124d31ed430b25` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:03.435759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=201d18f1d49f4f4b9f124d31ed430b25)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:03.435759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:38:03.435759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 28 05:38:03.435759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: Jul 28 05:38:03.435759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:03.775267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201d18f1d49f4f4b9f124d31ed430b25'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:03.777488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201d18f1d49f4f4b9f124d31ed430b25'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:04.003419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201d18f1d49f4f4b9f124d31ed430b25'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:04.004397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201d18f1d49f4f4b9f124d31ed430b25'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:04.029107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201d18f1d49f4f4b9f124d31ed430b25'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:04.049163 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 824/1644] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:03 2022] DELETE /identity/v3/users/201d18f1d49f4f4b9f124d31ed430b25 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:04.053839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1410b-9dbb-4ea1-b242-ce8891f5d6e6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:04.054726 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1410b-9dbb-4ea1-b242-ce8891f5d6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:04.055005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1410b-9dbb-4ea1-b242-ce8891f5d6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:04.076322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1ae1410b-9dbb-4ea1-b242-ce8891f5d6e6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:04.077660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1ae1410b-9dbb-4ea1-b242-ce8891f5d6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:04.144640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 821/1645] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:04.154778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:04.163617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:04.171610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:04.265942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ad21-e5cc-49dc-8f5a-5b65c1b447c1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:04.270538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c829e8-6f0a-4c63-83e2-61a49252f5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:04.271600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c829e8-6f0a-4c63-83e2-61a49252f5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:04.272095 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c829e8-6f0a-4c63-83e2-61a49252f5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:04.272964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c829e8-6f0a-4c63-83e2-61a49252f5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:04.286326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1410b-9dbb-4ea1-b242-ce8891f5d6e6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:04.289954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1ae1410b-9dbb-4ea1-b242-ce8891f5d6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:04.292811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c829e8-6f0a-4c63-83e2-61a49252f5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:04.295794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c829e8-6f0a-4c63-83e2-61a49252f5c2 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:04.316130 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 825/1646] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:04.318491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1410b-9dbb-4ea1-b242-ce8891f5d6e6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:04.325215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:04.325879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:04.326162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:04.326434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] PATH_INFO: `/v3/users/68338acbeca24792bbcf046711cc3767` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:04.328150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68338acbeca24792bbcf046711cc3767)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:04.330305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:04.565806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:04.569063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68338acbeca24792bbcf046711cc3767'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:04.684329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68338acbeca24792bbcf046711cc3767'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:04.685524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68338acbeca24792bbcf046711cc3767'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:04.687196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68338acbeca24792bbcf046711cc3767'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:04.717766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68338acbeca24792bbcf046711cc3767'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:04.748124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 822/1647] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:04 2022] DELETE /identity/v3/users/68338acbeca24792bbcf046711cc3767 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:04.750095 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b317332-c6a3-4fb2-895d-dd584294f529 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:04.751122 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b317332-c6a3-4fb2-895d-dd584294f529 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:04.751638 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b317332-c6a3-4fb2-895d-dd584294f529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:04.780647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7b317332-c6a3-4fb2-895d-dd584294f529 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:04.783516 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7b317332-c6a3-4fb2-895d-dd584294f529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:04.973364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 826/1648] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:05.113047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:05.114538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:05.215268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ee91d-546d-48f7-89a9-7ac3a491030b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:05.229763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8899c-f84a-44a3-b206-5bb1f31bf646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:05.232422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8899c-f84a-44a3-b206-5bb1f31bf646 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:05.232871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8899c-f84a-44a3-b206-5bb1f31bf646 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:05.233587 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8899c-f84a-44a3-b206-5bb1f31bf646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:05.247474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8899c-f84a-44a3-b206-5bb1f31bf646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:05.250733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8899c-f84a-44a3-b206-5bb1f31bf646 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:05.267427 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 823/1649] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:05.762356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b317332-c6a3-4fb2-895d-dd584294f529 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:05.763826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7b317332-c6a3-4fb2-895d-dd584294f529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:05.789378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b317332-c6a3-4fb2-895d-dd584294f529 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:05.794672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:05.795337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:05.795723 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:05.796009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] PATH_INFO: `/v3/projects/e42d3ec831cc431f86382eb815cf1a4f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:05.813691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42d3ec831cc431f86382eb815cf1a4f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:05.815775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:06.360775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42d3ec831cc431f86382eb815cf1a4f', 'request_id': 'req-78747f88-26f0-48d9-b5ba-2ed639b607d6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:06.368752 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42d3ec831cc431f86382eb815cf1a4f', 'request_id': 'req-78747f88-26f0-48d9-b5ba-2ed639b607d6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:06.381289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42d3ec831cc431f86382eb815cf1a4f', 'request_id': 'req-78747f88-26f0-48d9-b5ba-2ed639b607d6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:06.420601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8899c-f84a-44a3-b206-5bb1f31bf646 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:06.423262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e1e8899c-f84a-44a3-b206-5bb1f31bf646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:06.447896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8899c-f84a-44a3-b206-5bb1f31bf646 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:06.483741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] The token cache is being invalidate because project e42d3ec831cc431f86382eb815cf1a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:06.492779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:06.492779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-78747f88-26f0-48d9-b5ba-2ed639b607d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:06.492779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 827/1650] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:05 2022] DELETE /identity/v3/projects/e42d3ec831cc431f86382eb815cf1a4f => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:06.495983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec2b6b-e11a-458b-8633-66fc2f438faa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:06.495983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec2b6b-e11a-458b-8633-66fc2f438faa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:06.495983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec2b6b-e11a-458b-8633-66fc2f438faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:06.572844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-35ec2b6b-e11a-458b-8633-66fc2f438faa None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:06.574627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-35ec2b6b-e11a-458b-8633-66fc2f438faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:06.590177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:06.593454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:06.593749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:06.594184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] PATH_INFO: `/v3/projects/10e8b9ef3fd546d5b0497b68f4af21a6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:06.599291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e8b9ef3fd546d5b0497b68f4af21a6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:06.600736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 05:38:06.600736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 28 05:38:06.600736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: Jul 28 05:38:06.602805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:06.619351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 828/1651] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:06.630419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b44d-a1ec-4208-9850-e2b06b7f0454 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:06.631055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b44d-a1ec-4208-9850-e2b06b7f0454 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:06.631682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b44d-a1ec-4208-9850-e2b06b7f0454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:06.682969 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1938b44d-a1ec-4208-9850-e2b06b7f0454 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:06.684866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1938b44d-a1ec-4208-9850-e2b06b7f0454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:06.711077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 829/1652] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:06.717540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938b44d-a1ec-4208-9850-e2b06b7f0454 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:06.754534 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938b44d-a1ec-4208-9850-e2b06b7f0454 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:06.766923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff3377-7707-4668-bc3b-b33dbfa12a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:06.767911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff3377-7707-4668-bc3b-b33dbfa12a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:06.768853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff3377-7707-4668-bc3b-b33dbfa12a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:06.769356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff3377-7707-4668-bc3b-b33dbfa12a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:06.770919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff3377-7707-4668-bc3b-b33dbfa12a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:06.771445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff3377-7707-4668-bc3b-b33dbfa12a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:06.775016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff3377-7707-4668-bc3b-b33dbfa12a5a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:06.804752 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 830/1653] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:38:06.805919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff3377-7707-4668-bc3b-b33dbfa12a5a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:06.821047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:06.825158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff3377-7707-4668-bc3b-b33dbfa12a5a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:06.838513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6ad8b-aa3c-4434-8ef8-43589b0cf56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:06.839510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6ad8b-aa3c-4434-8ef8-43589b0cf56a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:06.839984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6ad8b-aa3c-4434-8ef8-43589b0cf56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:06.840653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6ad8b-aa3c-4434-8ef8-43589b0cf56a admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:06.842710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6ad8b-aa3c-4434-8ef8-43589b0cf56a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:06.845031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6ad8b-aa3c-4434-8ef8-43589b0cf56a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:06.937487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e8b9ef3fd546d5b0497b68f4af21a6', 'request_id': 'req-36e92e45-85f5-480d-8b4e-2ff3540b6312'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:06.964519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 831/1654] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:06 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:06.972161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6ad8b-aa3c-4434-8ef8-43589b0cf56a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:07.015485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e8b9ef3fd546d5b0497b68f4af21a6', 'request_id': 'req-36e92e45-85f5-480d-8b4e-2ff3540b6312'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.034525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e8b9ef3fd546d5b0497b68f4af21a6', 'request_id': 'req-36e92e45-85f5-480d-8b4e-2ff3540b6312'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.056477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:07.189202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] The token cache is being invalidate because project 10e8b9ef3fd546d5b0497b68f4af21a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:07.189202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.189202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.202908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 824/1655] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:06 2022] DELETE /identity/v3/projects/10e8b9ef3fd546d5b0497b68f4af21a6 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:07.211340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:07.211832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6ad8b-aa3c-4434-8ef8-43589b0cf56a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:07.218122 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:07.230990 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd2eff-835a-4fc3-8971-776eca22a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:07.231652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd2eff-835a-4fc3-8971-776eca22a9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:07.231931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd2eff-835a-4fc3-8971-776eca22a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:07.232201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd2eff-835a-4fc3-8971-776eca22a9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:07.232970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd2eff-835a-4fc3-8971-776eca22a9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:07.234835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd2eff-835a-4fc3-8971-776eca22a9e3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:07.367968 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 832/1656] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:06 2022] POST /identity/v3/users => generated 302 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:07.372060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd2eff-835a-4fc3-8971-776eca22a9e3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:07.373865 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-afdd2eff-835a-4fc3-8971-776eca22a9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:07.388758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92e45-85f5-480d-8b4e-2ff3540b6312 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:07.404453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:07.404453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:07.404453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:07.404453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] PATH_INFO: `/v3/users/4a600bf1c35e4c09b5345c4dd4c0666f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:07.404733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a600bf1c35e4c09b5345c4dd4c0666f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:07.410177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd2eff-835a-4fc3-8971-776eca22a9e3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:07.424938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a4c7b-7608-4712-ab08-dea75790bd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:07.432408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a4c7b-7608-4712-ab08-dea75790bd4c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:07.432408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a4c7b-7608-4712-ab08-dea75790bd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:07.432408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a4c7b-7608-4712-ab08-dea75790bd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:07.432408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a4c7b-7608-4712-ab08-dea75790bd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:07.432408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a4c7b-7608-4712-ab08-dea75790bd4c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:07.441126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:07.451784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 833/1657] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:38:07.455979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a4c7b-7608-4712-ab08-dea75790bd4c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:07.481983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a4c7b-7608-4712-ab08-dea75790bd4c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:07.498134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9438867-bea8-4e9b-8502-25395f21e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:07.499061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9438867-bea8-4e9b-8502-25395f21e479 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:07.502309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9438867-bea8-4e9b-8502-25395f21e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:07.502309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9438867-bea8-4e9b-8502-25395f21e479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:07.502309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9438867-bea8-4e9b-8502-25395f21e479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:07.502309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9438867-bea8-4e9b-8502-25395f21e479 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:07.540410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 834/1658] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:07.547274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9438867-bea8-4e9b-8502-25395f21e479 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:07.565007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9438867-bea8-4e9b-8502-25395f21e479 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:07.579508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12d00f-169a-4f0b-9652-cc3d7272a2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:07.583592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12d00f-169a-4f0b-9652-cc3d7272a2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:07.583592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12d00f-169a-4f0b-9652-cc3d7272a2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:07.583592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12d00f-169a-4f0b-9652-cc3d7272a2f6 admin admin] PATH_INFO: `/v3/projects/d50d9081dd704537925ac55e09eb529c/users/1660a27f6de0471b9105b73f3d3dcd1a/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:07.626699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12d00f-169a-4f0b-9652-cc3d7272a2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50d9081dd704537925ac55e09eb529c, user_id=1660a27f6de0471b9105b73f3d3dcd1a, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:07.633855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12d00f-169a-4f0b-9652-cc3d7272a2f6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:07.717537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 835/1659] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:07 2022] PUT /identity/v3/projects/d50d9081dd704537925ac55e09eb529c/users/1660a27f6de0471b9105b73f3d3dcd1a/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:07.722670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16899-c6fb-4e5a-bf50-e01c515bb6f7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:07.723169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16899-c6fb-4e5a-bf50-e01c515bb6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:07.723595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16899-c6fb-4e5a-bf50-e01c515bb6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:07.756984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a600bf1c35e4c09b5345c4dd4c0666f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.770218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f8e16899-c6fb-4e5a-bf50-e01c515bb6f7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:07.771608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f8e16899-c6fb-4e5a-bf50-e01c515bb6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:07.855651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a600bf1c35e4c09b5345c4dd4c0666f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.856339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a600bf1c35e4c09b5345c4dd4c0666f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.857162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a600bf1c35e4c09b5345c4dd4c0666f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.876433 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a600bf1c35e4c09b5345c4dd4c0666f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:07.882727 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 836/1660] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:07.911381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e16899-c6fb-4e5a-bf50-e01c515bb6f7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:07.914733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 825/1661] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:07 2022] DELETE /identity/v3/users/4a600bf1c35e4c09b5345c4dd4c0666f => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:07.918611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f8e16899-c6fb-4e5a-bf50-e01c515bb6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:08.046899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e16899-c6fb-4e5a-bf50-e01c515bb6f7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:08.171652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef74a4f-c1a0-401a-af8a-e3cd4a274471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:08.172357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef74a4f-c1a0-401a-af8a-e3cd4a274471 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:08.172630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef74a4f-c1a0-401a-af8a-e3cd4a274471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:08.172909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef74a4f-c1a0-401a-af8a-e3cd4a274471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:08.329801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:08.437595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef74a4f-c1a0-401a-af8a-e3cd4a274471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:08.443882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef74a4f-c1a0-401a-af8a-e3cd4a274471 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:08.468649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 837/1662] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:08.706342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:08.707938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:08.739072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fdc73-4e7f-4287-83f1-f09514e368e3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:08.756537 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:08.757835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:08.758126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:08.758432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] PATH_INFO: `/v3/users/e8e820139b4448ed9b29e97fb0ecef7e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:08.761977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e820139b4448ed9b29e97fb0ecef7e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:08.768759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:09.020782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e820139b4448ed9b29e97fb0ecef7e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:09.100444 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e820139b4448ed9b29e97fb0ecef7e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:09.101069 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e820139b4448ed9b29e97fb0ecef7e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:09.101798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e820139b4448ed9b29e97fb0ecef7e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:09.122697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:09.124569 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e820139b4448ed9b29e97fb0ecef7e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:09.168097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f10d93-86f9-4b6e-954e-bfa1ab4727e2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:09.169047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f10d93-86f9-4b6e-954e-bfa1ab4727e2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:09.169567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f10d93-86f9-4b6e-954e-bfa1ab4727e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:09.173105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 826/1663] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:08 2022] DELETE /identity/v3/users/e8e820139b4448ed9b29e97fb0ecef7e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:09.198985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-27f10d93-86f9-4b6e-954e-bfa1ab4727e2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:09.200322 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-27f10d93-86f9-4b6e-954e-bfa1ab4727e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:09.315835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 838/1664] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:09.370127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:09.374345 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:09.496766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccda95-000d-4fe5-a8a7-ccb68c385b6a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:09.508001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453258b5-d65f-4dd6-8f8a-d4f9a9358949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:09.508659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453258b5-d65f-4dd6-8f8a-d4f9a9358949 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:09.508947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453258b5-d65f-4dd6-8f8a-d4f9a9358949 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:09.511391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453258b5-d65f-4dd6-8f8a-d4f9a9358949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:09.535612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453258b5-d65f-4dd6-8f8a-d4f9a9358949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:09.540604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453258b5-d65f-4dd6-8f8a-d4f9a9358949 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:09.574113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 827/1665] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:10.131298 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f10d93-86f9-4b6e-954e-bfa1ab4727e2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:10.132819 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-27f10d93-86f9-4b6e-954e-bfa1ab4727e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:10.145484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f10d93-86f9-4b6e-954e-bfa1ab4727e2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.153121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.153968 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.154259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.154536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] PATH_INFO: `/v3/projects/0d9caa5e82c541abba80208f603f9b21` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.158134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9caa5e82c541abba80208f603f9b21)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.158134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:10.292792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:10.319083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9caa5e82c541abba80208f603f9b21', 'request_id': 'req-c1e44eea-93c6-4669-888f-60864a013b8c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:10.328900 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9caa5e82c541abba80208f603f9b21', 'request_id': 'req-c1e44eea-93c6-4669-888f-60864a013b8c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:10.339316 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9caa5e82c541abba80208f603f9b21', 'request_id': 'req-c1e44eea-93c6-4669-888f-60864a013b8c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:10.460514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] The token cache is being invalidate because project 0d9caa5e82c541abba80208f603f9b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:10.462413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:10.469292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c1e44eea-93c6-4669-888f-60864a013b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:10.472820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 839/1666] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:10 2022] DELETE /identity/v3/projects/0d9caa5e82c541abba80208f603f9b21 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:10.477949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b1fc-1fa9-49af-987e-90d9396b1ac4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.478761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b1fc-1fa9-49af-987e-90d9396b1ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.486573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1b1fc-1fa9-49af-987e-90d9396b1ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.524723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-03e1b1fc-1fa9-49af-987e-90d9396b1ac4 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:10.533907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-03e1b1fc-1fa9-49af-987e-90d9396b1ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:10.633562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 828/1667] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:10.642962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42147231-0b35-4e49-a42d-12f26de83d16 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.643817 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42147231-0b35-4e49-a42d-12f26de83d16 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.644313 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42147231-0b35-4e49-a42d-12f26de83d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.700044 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-42147231-0b35-4e49-a42d-12f26de83d16 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:10.703017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-42147231-0b35-4e49-a42d-12f26de83d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:10.729750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 840/1668] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:10.734366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1b1fc-1fa9-49af-987e-90d9396b1ac4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:10.751185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1b1fc-1fa9-49af-987e-90d9396b1ac4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.765234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9367f3d-0f62-4f8d-a4d9-7081eebecde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.765887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9367f3d-0f62-4f8d-a4d9-7081eebecde5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.768440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9367f3d-0f62-4f8d-a4d9-7081eebecde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.768750 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9367f3d-0f62-4f8d-a4d9-7081eebecde5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.769560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9367f3d-0f62-4f8d-a4d9-7081eebecde5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:10.785635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9367f3d-0f62-4f8d-a4d9-7081eebecde5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.785635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9367f3d-0f62-4f8d-a4d9-7081eebecde5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:10.831477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 829/1669] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:10.831572 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42147231-0b35-4e49-a42d-12f26de83d16 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:10.841793 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42147231-0b35-4e49-a42d-12f26de83d16 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:10.851617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b9a31-6c38-4dbf-984a-78192240249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:10.852486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b9a31-6c38-4dbf-984a-78192240249b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:10.860318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b9a31-6c38-4dbf-984a-78192240249b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:10.860318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b9a31-6c38-4dbf-984a-78192240249b admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:10.860318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b9a31-6c38-4dbf-984a-78192240249b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:10.860318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b9a31-6c38-4dbf-984a-78192240249b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:11.006525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 841/1670] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:10 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:11.011535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9367f3d-0f62-4f8d-a4d9-7081eebecde5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:11.035661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9367f3d-0f62-4f8d-a4d9-7081eebecde5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:11.189769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e203c9-a77d-439e-a774-8276afdafedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:11.191509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e203c9-a77d-439e-a774-8276afdafedc admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:11.192658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e203c9-a77d-439e-a774-8276afdafedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:11.193462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e203c9-a77d-439e-a774-8276afdafedc admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:11.197238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e203c9-a77d-439e-a774-8276afdafedc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:11.202289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e203c9-a77d-439e-a774-8276afdafedc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:11.348601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 830/1671] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:11 2022] POST /identity/v3/users => generated 283 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:11.352973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b9a31-6c38-4dbf-984a-78192240249b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:11.370686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b9a31-6c38-4dbf-984a-78192240249b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:11.388853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e207029-9c83-4626-8af6-7e48ee5ed276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:11.390111 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e207029-9c83-4626-8af6-7e48ee5ed276 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:11.390467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e207029-9c83-4626-8af6-7e48ee5ed276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:11.390808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e207029-9c83-4626-8af6-7e48ee5ed276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:11.392510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e207029-9c83-4626-8af6-7e48ee5ed276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:11.401244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e207029-9c83-4626-8af6-7e48ee5ed276 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:11.431393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 842/1672] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:11.431704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e203c9-a77d-439e-a774-8276afdafedc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:11.447775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e203c9-a77d-439e-a774-8276afdafedc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:11.468630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f3db1-398c-4c57-8fb7-16a8d420ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:11.468838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f3db1-398c-4c57-8fb7-16a8d420ff9c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:11.469172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f3db1-398c-4c57-8fb7-16a8d420ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:11.469857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f3db1-398c-4c57-8fb7-16a8d420ff9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:11.470649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f3db1-398c-4c57-8fb7-16a8d420ff9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:11.475918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f3db1-398c-4c57-8fb7-16a8d420ff9c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:11.479591 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:11.493688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 831/1673] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:11.498788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e207029-9c83-4626-8af6-7e48ee5ed276 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:11.513733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e207029-9c83-4626-8af6-7e48ee5ed276 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:11.520254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7efe92-650f-4d95-919d-66dd1bf06f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:11.521562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7efe92-650f-4d95-919d-66dd1bf06f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:11.522076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7efe92-650f-4d95-919d-66dd1bf06f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:11.522714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7efe92-650f-4d95-919d-66dd1bf06f23 admin admin] PATH_INFO: `/v3/projects/e156fc5d64d64880869f41883afcbef3/users/60f38452c3e44615beac0be295d0a696/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:11.549791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7efe92-650f-4d95-919d-66dd1bf06f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e156fc5d64d64880869f41883afcbef3, user_id=60f38452c3e44615beac0be295d0a696, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:11.553619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7efe92-650f-4d95-919d-66dd1bf06f23 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:11.673922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d8ccd-f110-4411-95b8-5122632f8422 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:11.675421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d8ccd-f110-4411-95b8-5122632f8422 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:11.676226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d8ccd-f110-4411-95b8-5122632f8422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:11.679868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 843/1674] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:11 2022] PUT /identity/v3/projects/e156fc5d64d64880869f41883afcbef3/users/60f38452c3e44615beac0be295d0a696/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:11.734816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cb1d8ccd-f110-4411-95b8-5122632f8422 None None] MFA Rules not processed for user `60f38452c3e44615beac0be295d0a696`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:11.737489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cb1d8ccd-f110-4411-95b8-5122632f8422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:11.882293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 832/1675] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:11.884336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7efe92-650f-4d95-919d-66dd1bf06f23 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:11.997598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7efe92-650f-4d95-919d-66dd1bf06f23 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:12.007580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785df5bc-2c00-4df0-bd2b-946b02bdb07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:12.008547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785df5bc-2c00-4df0-bd2b-946b02bdb07c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:12.009321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785df5bc-2c00-4df0-bd2b-946b02bdb07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:12.009841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785df5bc-2c00-4df0-bd2b-946b02bdb07c admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:12.011447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785df5bc-2c00-4df0-bd2b-946b02bdb07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:12.014578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785df5bc-2c00-4df0-bd2b-946b02bdb07c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:12.116150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 844/1676] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:11 2022] POST /identity/v3/projects => generated 363 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:12.118043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d8ccd-f110-4411-95b8-5122632f8422 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:12.144322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d8ccd-f110-4411-95b8-5122632f8422 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:12.254288 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1196c-5134-4055-a7b6-176eef362679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:12.254935 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1196c-5134-4055-a7b6-176eef362679 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:12.255227 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1196c-5134-4055-a7b6-176eef362679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:12.255504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1196c-5134-4055-a7b6-176eef362679 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:12.256193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1196c-5134-4055-a7b6-176eef362679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:12.258755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1196c-5134-4055-a7b6-176eef362679 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:12.388807 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 833/1677] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:12 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:12.393683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785df5bc-2c00-4df0-bd2b-946b02bdb07c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:12.458509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785df5bc-2c00-4df0-bd2b-946b02bdb07c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:12.471941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06a6a1-42d9-40d6-99f7-b0e9bc9b534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:12.472761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06a6a1-42d9-40d6-99f7-b0e9bc9b534b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:12.473069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06a6a1-42d9-40d6-99f7-b0e9bc9b534b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:12.474023 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06a6a1-42d9-40d6-99f7-b0e9bc9b534b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:12.475631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06a6a1-42d9-40d6-99f7-b0e9bc9b534b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:12.478747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06a6a1-42d9-40d6-99f7-b0e9bc9b534b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:12.506163 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 845/1678] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:12.512689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1196c-5134-4055-a7b6-176eef362679 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:12.558916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1196c-5134-4055-a7b6-176eef362679 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:12.565774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdbd91-d046-4de5-a8f0-a16a17025799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:12.567536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbd91-d046-4de5-a8f0-a16a17025799 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:12.567821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbd91-d046-4de5-a8f0-a16a17025799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:12.568097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbd91-d046-4de5-a8f0-a16a17025799 admin admin] PATH_INFO: `/v3/projects/05fe4886cb514096b4af338f25f89515/users/03701ec3a333406d8c82e770489ce501/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:12.595614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdbd91-d046-4de5-a8f0-a16a17025799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fe4886cb514096b4af338f25f89515, user_id=03701ec3a333406d8c82e770489ce501, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:12.603416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdbd91-d046-4de5-a8f0-a16a17025799 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:12.718967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 834/1679] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:12 2022] PUT /identity/v3/projects/05fe4886cb514096b4af338f25f89515/users/03701ec3a333406d8c82e770489ce501/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:12.723100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06a6a1-42d9-40d6-99f7-b0e9bc9b534b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:12.735806 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06a6a1-42d9-40d6-99f7-b0e9bc9b534b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:12.802560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:12.838394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdbd91-d046-4de5-a8f0-a16a17025799 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:12.842403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38fdbd91-d046-4de5-a8f0-a16a17025799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:12.921298 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edb5fa-77e2-490c-9159-dfb830c8b661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:12.921953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edb5fa-77e2-490c-9159-dfb830c8b661 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:12.922238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edb5fa-77e2-490c-9159-dfb830c8b661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:12.922515 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edb5fa-77e2-490c-9159-dfb830c8b661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:12.923224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edb5fa-77e2-490c-9159-dfb830c8b661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:12.925004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edb5fa-77e2-490c-9159-dfb830c8b661 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:12.969630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 846/1680] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:12.974186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edb5fa-77e2-490c-9159-dfb830c8b661 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:12.991958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edb5fa-77e2-490c-9159-dfb830c8b661 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:12.999443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:13.002577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21982ae0-9899-4935-8fcf-40ad6a35f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:13.003482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21982ae0-9899-4935-8fcf-40ad6a35f0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:13.003840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21982ae0-9899-4935-8fcf-40ad6a35f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:13.004460 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21982ae0-9899-4935-8fcf-40ad6a35f0bd admin admin] PATH_INFO: `/v3/projects/05fe4886cb514096b4af338f25f89515/users/03701ec3a333406d8c82e770489ce501/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:13.006913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21982ae0-9899-4935-8fcf-40ad6a35f0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fe4886cb514096b4af338f25f89515, user_id=03701ec3a333406d8c82e770489ce501, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:13.011282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21982ae0-9899-4935-8fcf-40ad6a35f0bd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:13.031890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdbd91-d046-4de5-a8f0-a16a17025799 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:13.039132 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 847/1681] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:12 2022] PUT /identity/v3/projects/05fe4886cb514096b4af338f25f89515/users/03701ec3a333406d8c82e770489ce501/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:13.063634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edff356-9fa3-42aa-9f97-5ced205c36d4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:13.065509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edff356-9fa3-42aa-9f97-5ced205c36d4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:13.066083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edff356-9fa3-42aa-9f97-5ced205c36d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:13.132921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7edff356-9fa3-42aa-9f97-5ced205c36d4 None None] MFA Rules not processed for user `03701ec3a333406d8c82e770489ce501`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:13.135722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7edff356-9fa3-42aa-9f97-5ced205c36d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:13.169354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:13.170877 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:13.170877 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:13.170877 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] PATH_INFO: `/v3/projects/61a1594cca114a7e870990609b5e0d55` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:13.177163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a1594cca114a7e870990609b5e0d55)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:13.179995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:13.306167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 848/1682] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:13.319802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edff356-9fa3-42aa-9f97-5ced205c36d4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:13.321516 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7edff356-9fa3-42aa-9f97-5ced205c36d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:13.380041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a1594cca114a7e870990609b5e0d55', 'request_id': 'req-8e9eeb6a-4192-4866-996a-27eff882685e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:13.397894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a1594cca114a7e870990609b5e0d55', 'request_id': 'req-8e9eeb6a-4192-4866-996a-27eff882685e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:13.411424 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a1594cca114a7e870990609b5e0d55', 'request_id': 'req-8e9eeb6a-4192-4866-996a-27eff882685e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:13.513069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edff356-9fa3-42aa-9f97-5ced205c36d4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:13.531695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] The token cache is being invalidate because project 61a1594cca114a7e870990609b5e0d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:13.531695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:13.531695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e9eeb6a-4192-4866-996a-27eff882685e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:13.531695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 835/1683] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:12 2022] DELETE /identity/v3/projects/61a1594cca114a7e870990609b5e0d55 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:13.535407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04e58-3a22-400d-93ce-c016a8faff43 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:13.535698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04e58-3a22-400d-93ce-c016a8faff43 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:13.535975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04e58-3a22-400d-93ce-c016a8faff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:13.584212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ecc04e58-3a22-400d-93ce-c016a8faff43 None None] MFA Rules not processed for user `1660a27f6de0471b9105b73f3d3dcd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:13.586019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ecc04e58-3a22-400d-93ce-c016a8faff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:13.633837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e43417-46c7-41aa-b34d-6204a03972ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:13.634828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e43417-46c7-41aa-b34d-6204a03972ee service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:13.635806 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e43417-46c7-41aa-b34d-6204a03972ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:13.636522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e43417-46c7-41aa-b34d-6204a03972ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:13.644031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11e43417-46c7-41aa-b34d-6204a03972ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:13.705321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 836/1684] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:13.705321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc04e58-3a22-400d-93ce-c016a8faff43 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:13.706154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ecc04e58-3a22-400d-93ce-c016a8faff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:13.808181 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e43417-46c7-41aa-b34d-6204a03972ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:13.809700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e43417-46c7-41aa-b34d-6204a03972ee service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:13.834978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 849/1685] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:13.835829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e43417-46c7-41aa-b34d-6204a03972ee service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:13.837349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11e43417-46c7-41aa-b34d-6204a03972ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:13.913539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc04e58-3a22-400d-93ce-c016a8faff43 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:13.926526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:13.927656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:13.927656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:13.927936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] PATH_INFO: `/v3/users/bfaf6f93dd1f49819044dc978872f4f9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:13.931058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfaf6f93dd1f49819044dc978872f4f9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:13.935081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:13.955205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e43417-46c7-41aa-b34d-6204a03972ee service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:13.961723 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42999f-4744-47e4-87ef-5e2fbcf780f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:13.963069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42999f-4744-47e4-87ef-5e2fbcf780f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:13.963069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42999f-4744-47e4-87ef-5e2fbcf780f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:13.963069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42999f-4744-47e4-87ef-5e2fbcf780f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:13.963784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42999f-4744-47e4-87ef-5e2fbcf780f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:13.967835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42999f-4744-47e4-87ef-5e2fbcf780f9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:14.199771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 850/1686] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:13 2022] POST /identity/v3/projects => generated 403 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:14.204716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42999f-4744-47e4-87ef-5e2fbcf780f9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:14.267678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:14.292949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfaf6f93dd1f49819044dc978872f4f9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:14.321160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42999f-4744-47e4-87ef-5e2fbcf780f9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:14.329821 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c48e3-4dfa-4f8d-81f2-e056786ff004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:14.331323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c48e3-4dfa-4f8d-81f2-e056786ff004 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:14.333034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c48e3-4dfa-4f8d-81f2-e056786ff004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:14.333532 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c48e3-4dfa-4f8d-81f2-e056786ff004 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:14.334741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c48e3-4dfa-4f8d-81f2-e056786ff004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:14.338014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c48e3-4dfa-4f8d-81f2-e056786ff004 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:14.409090 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfaf6f93dd1f49819044dc978872f4f9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:14.409842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfaf6f93dd1f49819044dc978872f4f9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:14.410479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfaf6f93dd1f49819044dc978872f4f9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:14.437075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfaf6f93dd1f49819044dc978872f4f9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:14.467499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 851/1687] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:14 2022] POST /identity/v3/users => generated 308 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:14.469622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c48e3-4dfa-4f8d-81f2-e056786ff004 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:14.470604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 837/1688] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:13 2022] DELETE /identity/v3/users/bfaf6f93dd1f49819044dc978872f4f9 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:14.472099 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:14.473074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd9c48e3-4dfa-4f8d-81f2-e056786ff004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:14.475077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:14.578282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b50a3-c1bb-466c-87bc-ba1730d8d8ed admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:14.583685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6335f9-3a39-4598-9bc0-a204b85bb1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:14.584711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6335f9-3a39-4598-9bc0-a204b85bb1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:14.584997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6335f9-3a39-4598-9bc0-a204b85bb1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:14.585378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6335f9-3a39-4598-9bc0-a204b85bb1cf admin admin] PATH_INFO: `/v3/users/2501ba114a934051a678f0721f487bc5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:14.586611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6335f9-3a39-4598-9bc0-a204b85bb1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2501ba114a934051a678f0721f487bc5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:14.589794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6335f9-3a39-4598-9bc0-a204b85bb1cf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:14.618631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c48e3-4dfa-4f8d-81f2-e056786ff004 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:14.722100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c8a66-a59a-4f39-baef-3809b66d0345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:14.723057 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c8a66-a59a-4f39-baef-3809b66d0345 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:14.723555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c8a66-a59a-4f39-baef-3809b66d0345 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:14.724064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c8a66-a59a-4f39-baef-3809b66d0345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:14.732684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-043c8a66-a59a-4f39-baef-3809b66d0345 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:14.841676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b6335f9-3a39-4598-9bc0-a204b85bb1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2501ba114a934051a678f0721f487bc5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:14.847999 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:14.861720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c8a66-a59a-4f39-baef-3809b66d0345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:14.863200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c8a66-a59a-4f39-baef-3809b66d0345 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:14.883241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 852/1689] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:14.886117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c8a66-a59a-4f39-baef-3809b66d0345 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:14.896831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-043c8a66-a59a-4f39-baef-3809b66d0345 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:14.928043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c8a66-a59a-4f39-baef-3809b66d0345 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:14.933453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b6335f9-3a39-4598-9bc0-a204b85bb1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2501ba114a934051a678f0721f487bc5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:14.934096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b6335f9-3a39-4598-9bc0-a204b85bb1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2501ba114a934051a678f0721f487bc5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:14.934724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b6335f9-3a39-4598-9bc0-a204b85bb1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2501ba114a934051a678f0721f487bc5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:14.940412 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39968-ec14-477c-a2de-68d71bb9e815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:14.941052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39968-ec14-477c-a2de-68d71bb9e815 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:14.941394 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39968-ec14-477c-a2de-68d71bb9e815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:14.941679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39968-ec14-477c-a2de-68d71bb9e815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:14.942386 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de39968-ec14-477c-a2de-68d71bb9e815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:14.943988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de39968-ec14-477c-a2de-68d71bb9e815 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:14.968985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 853/1690] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:14.970110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39968-ec14-477c-a2de-68d71bb9e815 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:14.976162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0de39968-ec14-477c-a2de-68d71bb9e815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:14.980470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b6335f9-3a39-4598-9bc0-a204b85bb1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2501ba114a934051a678f0721f487bc5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:15.010599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39968-ec14-477c-a2de-68d71bb9e815 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:15.016020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 838/1691] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:14 2022] DELETE /identity/v3/users/2501ba114a934051a678f0721f487bc5 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:15.020640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343e8be-185c-4ba3-9f52-3025f36c1cc0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:15.021099 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343e8be-185c-4ba3-9f52-3025f36c1cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:15.021502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343e8be-185c-4ba3-9f52-3025f36c1cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:15.039568 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb40d2-e7c5-488a-97a2-76868d95eeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:15.040280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb40d2-e7c5-488a-97a2-76868d95eeb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:15.040564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb40d2-e7c5-488a-97a2-76868d95eeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:15.040838 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb40d2-e7c5-488a-97a2-76868d95eeb9 admin admin] PATH_INFO: `/v3/projects/63822964d9d84721a902a6ac9fa9c844/users/c2a440a6d89f427dbb05cca5e91820af/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:15.054300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4343e8be-185c-4ba3-9f52-3025f36c1cc0 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:15.055686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4343e8be-185c-4ba3-9f52-3025f36c1cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:15.095775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb40d2-e7c5-488a-97a2-76868d95eeb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63822964d9d84721a902a6ac9fa9c844, user_id=c2a440a6d89f427dbb05cca5e91820af, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:15.099149 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb40d2-e7c5-488a-97a2-76868d95eeb9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:15.167009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 839/1692] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:15.192374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 854/1693] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:14 2022] PUT /identity/v3/projects/63822964d9d84721a902a6ac9fa9c844/users/c2a440a6d89f427dbb05cca5e91820af/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:15.204376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343e8be-185c-4ba3-9f52-3025f36c1cc0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:15.221205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb40d2-e7c5-488a-97a2-76868d95eeb9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:15.224171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6eeb40d2-e7c5-488a-97a2-76868d95eeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:15.229535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343e8be-185c-4ba3-9f52-3025f36c1cc0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:15.389334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe4f6a-b9c9-4db7-aeb7-d3275091c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:15.390295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe4f6a-b9c9-4db7-aeb7-d3275091c083 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:15.390866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe4f6a-b9c9-4db7-aeb7-d3275091c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:15.391537 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe4f6a-b9c9-4db7-aeb7-d3275091c083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:15.392431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe4f6a-b9c9-4db7-aeb7-d3275091c083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:15.402015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe4f6a-b9c9-4db7-aeb7-d3275091c083 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:15.408221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb40d2-e7c5-488a-97a2-76868d95eeb9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:15.413562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c256cc1-dcef-42d4-aad6-cd2b82011b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:15.415703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c256cc1-dcef-42d4-aad6-cd2b82011b2d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:15.415703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c256cc1-dcef-42d4-aad6-cd2b82011b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:15.415703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c256cc1-dcef-42d4-aad6-cd2b82011b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:15.432234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 840/1694] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:15.435055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe4f6a-b9c9-4db7-aeb7-d3275091c083 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:15.497310 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c256cc1-dcef-42d4-aad6-cd2b82011b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:15.505160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c256cc1-dcef-42d4-aad6-cd2b82011b2d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:15.506293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe4f6a-b9c9-4db7-aeb7-d3275091c083 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:15.553767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb70b5-ad03-4357-9928-b5b50694760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:15.557019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb70b5-ad03-4357-9928-b5b50694760d admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:15.557565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb70b5-ad03-4357-9928-b5b50694760d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:15.557991 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb70b5-ad03-4357-9928-b5b50694760d admin admin] PATH_INFO: `/v3/projects/63822964d9d84721a902a6ac9fa9c844/users/c2a440a6d89f427dbb05cca5e91820af/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:15.559125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 855/1695] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:15.565360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb70b5-ad03-4357-9928-b5b50694760d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63822964d9d84721a902a6ac9fa9c844, user_id=c2a440a6d89f427dbb05cca5e91820af, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:15.570640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb70b5-ad03-4357-9928-b5b50694760d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:15.636461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 841/1696] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:15 2022] PUT /identity/v3/projects/63822964d9d84721a902a6ac9fa9c844/users/c2a440a6d89f427dbb05cca5e91820af/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:16.095416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:16.180283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:16.425515 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c4bc-30a7-40ba-a03b-32fae1549d51 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:16.426432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c4bc-30a7-40ba-a03b-32fae1549d51 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:16.426989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c4bc-30a7-40ba-a03b-32fae1549d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:16.503523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f733c4bc-30a7-40ba-a03b-32fae1549d51 None None] MFA Rules not processed for user `9b14f38f371b405f915a7a9ba8c61569`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:16.513334 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f733c4bc-30a7-40ba-a03b-32fae1549d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:16.540212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb70b5-ad03-4357-9928-b5b50694760d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:16.542440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4dfb70b5-ad03-4357-9928-b5b50694760d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:16.694080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 856/1697] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:16.702678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220d9de-7be1-47ab-ab81-bac56e5edf5f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:16.703393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220d9de-7be1-47ab-ab81-bac56e5edf5f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:16.703866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220d9de-7be1-47ab-ab81-bac56e5edf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:16.714437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb70b5-ad03-4357-9928-b5b50694760d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:16.727683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:16.729007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:16.730140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:16.730623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] PATH_INFO: `/v3/projects/6f48e29bafad4683bafc184a23a3559b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:16.733918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f48e29bafad4683bafc184a23a3559b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:16.739056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:16.753952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a220d9de-7be1-47ab-ab81-bac56e5edf5f None None] MFA Rules not processed for user `69a74a81980947d9a2499a4d9ad65823`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:16.756217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a220d9de-7be1-47ab-ab81-bac56e5edf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:16.959962 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f48e29bafad4683bafc184a23a3559b', 'request_id': 'req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:16.976889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 857/1698] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:16.980423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220d9de-7be1-47ab-ab81-bac56e5edf5f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:16.990825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a220d9de-7be1-47ab-ab81-bac56e5edf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:17.007982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f48e29bafad4683bafc184a23a3559b', 'request_id': 'req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:17.026335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f48e29bafad4683bafc184a23a3559b', 'request_id': 'req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:17.111685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] The token cache is being invalidate because project 6f48e29bafad4683bafc184a23a3559b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:17.112395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:17.115441 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13d6fd7f-eae9-489f-a45e-b1aef2913d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:17.117362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 842/1699] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:16 2022] DELETE /identity/v3/projects/6f48e29bafad4683bafc184a23a3559b => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:17.120042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341d2e7-3799-4b8c-9222-b274da9dcc04 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:17.120811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341d2e7-3799-4b8c-9222-b274da9dcc04 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:17.124511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341d2e7-3799-4b8c-9222-b274da9dcc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:17.168762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220d9de-7be1-47ab-ab81-bac56e5edf5f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:17.174262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e341d2e7-3799-4b8c-9222-b274da9dcc04 None None] MFA Rules not processed for user `69a74a81980947d9a2499a4d9ad65823`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:17.177399 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e341d2e7-3799-4b8c-9222-b274da9dcc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:17.395446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 843/1700] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:17.397471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f0cd6-a542-47c9-b024-b77f0eb9b7cd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:17.397947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f0cd6-a542-47c9-b024-b77f0eb9b7cd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:17.398377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f0cd6-a542-47c9-b024-b77f0eb9b7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:17.398485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:17.462454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-838f0cd6-a542-47c9-b024-b77f0eb9b7cd None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:17.464095 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-838f0cd6-a542-47c9-b024-b77f0eb9b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:17.498866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2d09-d8aa-44b2-8889-d32c71542e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:17.500513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2d09-d8aa-44b2-8889-d32c71542e70 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:17.501431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2d09-d8aa-44b2-8889-d32c71542e70 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:17.501431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2d09-d8aa-44b2-8889-d32c71542e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:17.513751 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f13c2d09-d8aa-44b2-8889-d32c71542e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:17.588562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 844/1701] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:17.599792 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f0cd6-a542-47c9-b024-b77f0eb9b7cd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:17.599792 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-838f0cd6-a542-47c9-b024-b77f0eb9b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:17.613464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f0cd6-a542-47c9-b024-b77f0eb9b7cd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:17.628455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:17.628455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:17.628455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:17.628455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] PATH_INFO: `/v3/projects/bfd022889b8842abb88809ec34a6f041` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:17.630451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd022889b8842abb88809ec34a6f041)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:17.635678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:17.678870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c2d09-d8aa-44b2-8889-d32c71542e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:17.681049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c2d09-d8aa-44b2-8889-d32c71542e70 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:17.714699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 858/1702] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:17.716936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2d09-d8aa-44b2-8889-d32c71542e70 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:17.720171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f13c2d09-d8aa-44b2-8889-d32c71542e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:17.753903 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2d09-d8aa-44b2-8889-d32c71542e70 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:17.786087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd022889b8842abb88809ec34a6f041', 'request_id': 'req-b92c9969-c4f2-4b0e-9189-d322629a47b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:17.804558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd022889b8842abb88809ec34a6f041', 'request_id': 'req-b92c9969-c4f2-4b0e-9189-d322629a47b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:17.818132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd022889b8842abb88809ec34a6f041', 'request_id': 'req-b92c9969-c4f2-4b0e-9189-d322629a47b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:17.927869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] The token cache is being invalidate because project bfd022889b8842abb88809ec34a6f041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:17.930296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:17.930296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b92c9969-c4f2-4b0e-9189-d322629a47b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:17.932568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 845/1703] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:17 2022] DELETE /identity/v3/projects/bfd022889b8842abb88809ec34a6f041 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:17.935094 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b04a4e-6f79-4791-adc3-7c8d28edd999 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:17.935428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b04a4e-6f79-4791-adc3-7c8d28edd999 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:17.935709 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b04a4e-6f79-4791-adc3-7c8d28edd999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:17.943500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294e54f-65ce-4811-9172-c5fa579f4573 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:17.947106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e54f-65ce-4811-9172-c5fa579f4573 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:17.951431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e54f-65ce-4811-9172-c5fa579f4573 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:17.951431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e54f-65ce-4811-9172-c5fa579f4573 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:17.959222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b294e54f-65ce-4811-9172-c5fa579f4573 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:18.002033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c0b04a4e-6f79-4791-adc3-7c8d28edd999 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:18.003278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c0b04a4e-6f79-4791-adc3-7c8d28edd999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:18.009020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:18.125475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294e54f-65ce-4811-9172-c5fa579f4573 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:18.130068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294e54f-65ce-4811-9172-c5fa579f4573 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:18.170381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 846/1704] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:18.171782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbcccf-de3c-4508-9b6b-9a6650b6d9f6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:18.176369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbcccf-de3c-4508-9b6b-9a6650b6d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:18.176369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbcccf-de3c-4508-9b6b-9a6650b6d9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:18.219123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 859/1705] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:18.222928 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a0b9-f4c9-46c1-b6d3-05bcdfd3a8ec None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:18.228042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a0b9-f4c9-46c1-b6d3-05bcdfd3a8ec None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:18.228352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a0b9-f4c9-46c1-b6d3-05bcdfd3a8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:18.246173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a3bbcccf-de3c-4508-9b6b-9a6650b6d9f6 None None] MFA Rules not processed for user `e728ae311b604bbcaf41f91562bffbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:18.247391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a3bbcccf-de3c-4508-9b6b-9a6650b6d9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:18.272907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b1f0a0b9-f4c9-46c1-b6d3-05bcdfd3a8ec None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:18.277006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b1f0a0b9-f4c9-46c1-b6d3-05bcdfd3a8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:18.300215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 860/1706] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:18.302162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a0b9-f4c9-46c1-b6d3-05bcdfd3a8ec None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:18.322889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a0b9-f4c9-46c1-b6d3-05bcdfd3a8ec None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:18.337209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf345473-589a-4a66-814c-0a3fa0d92169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:18.337209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf345473-589a-4a66-814c-0a3fa0d92169 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:18.337209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf345473-589a-4a66-814c-0a3fa0d92169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:18.337209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf345473-589a-4a66-814c-0a3fa0d92169 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:18.337586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf345473-589a-4a66-814c-0a3fa0d92169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:18.338776 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf345473-589a-4a66-814c-0a3fa0d92169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:18.343194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf345473-589a-4a66-814c-0a3fa0d92169 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:18.371243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 861/1707] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:18.373413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983f846-b1f2-4b9d-a595-91bf7aedb40e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:18.375282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983f846-b1f2-4b9d-a595-91bf7aedb40e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:18.375752 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 847/1708] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:18.385116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983f846-b1f2-4b9d-a595-91bf7aedb40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:18.387793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbcccf-de3c-4508-9b6b-9a6650b6d9f6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:18.397407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:18.413362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbcccf-de3c-4508-9b6b-9a6650b6d9f6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:18.431154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0983f846-b1f2-4b9d-a595-91bf7aedb40e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:18.433010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f63c5-a10e-416a-b993-b6569ba5b51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:18.433756 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f63c5-a10e-416a-b993-b6569ba5b51e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:18.434040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f63c5-a10e-416a-b993-b6569ba5b51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:18.434309 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f63c5-a10e-416a-b993-b6569ba5b51e admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:18.435270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f63c5-a10e-416a-b993-b6569ba5b51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:18.437250 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f63c5-a10e-416a-b993-b6569ba5b51e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:18.442839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0983f846-b1f2-4b9d-a595-91bf7aedb40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:18.461798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 862/1709] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:18.462647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983f846-b1f2-4b9d-a595-91bf7aedb40e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:18.464514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0983f846-b1f2-4b9d-a595-91bf7aedb40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:18.515327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983f846-b1f2-4b9d-a595-91bf7aedb40e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:18.525175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55f059-21d5-4cc2-bd79-f216a37f8b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:18.525175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55f059-21d5-4cc2-bd79-f216a37f8b47 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:18.525175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55f059-21d5-4cc2-bd79-f216a37f8b47 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:18.525175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55f059-21d5-4cc2-bd79-f216a37f8b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:18.538305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55f059-21d5-4cc2-bd79-f216a37f8b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:18.542457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55f059-21d5-4cc2-bd79-f216a37f8b47 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:18.557227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 863/1710] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:18.558524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55f059-21d5-4cc2-bd79-f216a37f8b47 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:18.569875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 848/1711] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:18 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:18.574620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f63c5-a10e-416a-b993-b6569ba5b51e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:18.599559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55f059-21d5-4cc2-bd79-f216a37f8b47 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:18.743129 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f63c5-a10e-416a-b993-b6569ba5b51e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:18.749169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3f55-638f-4d7e-94b0-baae74ed542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:18.751773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3f55-638f-4d7e-94b0-baae74ed542f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:18.752061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3f55-638f-4d7e-94b0-baae74ed542f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:18.752333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3f55-638f-4d7e-94b0-baae74ed542f admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:18.753062 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c3f55-638f-4d7e-94b0-baae74ed542f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:18.753390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c3f55-638f-4d7e-94b0-baae74ed542f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:18.757580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672a1ff-d831-4a10-ab61-194cf0e3d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:18.758211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672a1ff-d831-4a10-ab61-194cf0e3d6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:18.758489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672a1ff-d831-4a10-ab61-194cf0e3d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:18.758756 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672a1ff-d831-4a10-ab61-194cf0e3d6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:18.759430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672a1ff-d831-4a10-ab61-194cf0e3d6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:18.761382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c3f55-638f-4d7e-94b0-baae74ed542f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:18.766651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672a1ff-d831-4a10-ab61-194cf0e3d6e9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:18.789234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 864/1712] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:18.794474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3f55-638f-4d7e-94b0-baae74ed542f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:18.806281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3f55-638f-4d7e-94b0-baae74ed542f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:18.812436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291a82d-e949-47d8-b278-9aca0547b116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:18.813444 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a82d-e949-47d8-b278-9aca0547b116 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:18.813727 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a82d-e949-47d8-b278-9aca0547b116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:18.814001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291a82d-e949-47d8-b278-9aca0547b116 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:18.814676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291a82d-e949-47d8-b278-9aca0547b116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:18.816747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291a82d-e949-47d8-b278-9aca0547b116 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:18.906101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 849/1713] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:18 2022] POST /identity/v3/users => generated 289 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:18.932818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672a1ff-d831-4a10-ab61-194cf0e3d6e9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:18.943244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:18.951632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 865/1714] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:18 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:18.955914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291a82d-e949-47d8-b278-9aca0547b116 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:18.990181 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672a1ff-d831-4a10-ab61-194cf0e3d6e9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:19.124815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660ef7c-1a1a-4bb2-9afd-7be5cff7d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:19.125401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660ef7c-1a1a-4bb2-9afd-7be5cff7d966 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:19.131649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660ef7c-1a1a-4bb2-9afd-7be5cff7d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:19.131649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660ef7c-1a1a-4bb2-9afd-7be5cff7d966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:19.131649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660ef7c-1a1a-4bb2-9afd-7be5cff7d966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:19.131649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660ef7c-1a1a-4bb2-9afd-7be5cff7d966 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:19.159287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291a82d-e949-47d8-b278-9aca0547b116 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:19.173229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 850/1715] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:19.184765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660ef7c-1a1a-4bb2-9afd-7be5cff7d966 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:19.193434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbcdfa-777f-4810-94d2-b27f802cc04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:19.194305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbcdfa-777f-4810-94d2-b27f802cc04a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:19.194724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbcdfa-777f-4810-94d2-b27f802cc04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:19.195133 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbcdfa-777f-4810-94d2-b27f802cc04a admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:19.196119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbcdfa-777f-4810-94d2-b27f802cc04a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:19.200867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbcdfa-777f-4810-94d2-b27f802cc04a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:19.218348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660ef7c-1a1a-4bb2-9afd-7be5cff7d966 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:19.249958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4390d37-275f-4730-82f9-e940dfaf995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:19.250593 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4390d37-275f-4730-82f9-e940dfaf995f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:19.250877 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4390d37-275f-4730-82f9-e940dfaf995f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:19.251151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4390d37-275f-4730-82f9-e940dfaf995f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:19.251861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4390d37-275f-4730-82f9-e940dfaf995f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:19.253528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4390d37-275f-4730-82f9-e940dfaf995f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:19.293726 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 851/1716] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:19.294739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4390d37-275f-4730-82f9-e940dfaf995f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:19.329423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4390d37-275f-4730-82f9-e940dfaf995f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:19.350150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d2390-ef0e-46b4-89a0-c30b3a38801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:19.351091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2390-ef0e-46b4-89a0-c30b3a38801b admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:19.351515 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2390-ef0e-46b4-89a0-c30b3a38801b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:19.351935 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2390-ef0e-46b4-89a0-c30b3a38801b admin admin] PATH_INFO: `/v3/projects/c0366200688f46b9b2cc801e230093b7/users/d7acb3eed80e47818d8b83ef68529a7e/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:19.368584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 866/1717] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:18 2022] POST /identity/v3/users => generated 286 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:19.371120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53deb6-7fb4-4619-9624-3f4a73b6d02f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:19.371469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53deb6-7fb4-4619-9624-3f4a73b6d02f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:19.371754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53deb6-7fb4-4619-9624-3f4a73b6d02f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:19.373681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 867/1718] 10.222.0.42 () {54 vars in 912 bytes} [Thu Jul 28 05:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:38:19.374443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53deb6-7fb4-4619-9624-3f4a73b6d02f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:19.418837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d2390-ef0e-46b4-89a0-c30b3a38801b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0366200688f46b9b2cc801e230093b7, user_id=d7acb3eed80e47818d8b83ef68529a7e, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:19.421894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d2390-ef0e-46b4-89a0-c30b3a38801b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:19.495212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53deb6-7fb4-4619-9624-3f4a73b6d02f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:19.515171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339b816-944d-4703-a1d1-b0d3eaefc0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:19.517545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339b816-944d-4703-a1d1-b0d3eaefc0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:19.518072 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339b816-944d-4703-a1d1-b0d3eaefc0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:19.519855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339b816-944d-4703-a1d1-b0d3eaefc0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:19.520876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339b816-944d-4703-a1d1-b0d3eaefc0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:19.529353 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339b816-944d-4703-a1d1-b0d3eaefc0f2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:19.545741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:19.548057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 852/1719] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:19 2022] PUT /identity/v3/projects/c0366200688f46b9b2cc801e230093b7/users/d7acb3eed80e47818d8b83ef68529a7e/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:19.555637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e368-b579-4a9d-b1b2-b9626bbd84a8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:19.555637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e368-b579-4a9d-b1b2-b9626bbd84a8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:19.555637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e368-b579-4a9d-b1b2-b9626bbd84a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:19.557807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 868/1720] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:19.559237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ccb41-2821-4ec0-a6f2-cac34ea737cb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:19.559525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ccb41-2821-4ec0-a6f2-cac34ea737cb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:19.559804 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ccb41-2821-4ec0-a6f2-cac34ea737cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:19.607610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:19.638453 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-900ccb41-2821-4ec0-a6f2-cac34ea737cb None None] MFA Rules not processed for user `c2a440a6d89f427dbb05cca5e91820af`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:19.652656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3da5e368-b579-4a9d-b1b2-b9626bbd84a8 None None] MFA Rules not processed for user `76596e04e82b43cb8b68ee2f5e6dd9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:19.654197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-900ccb41-2821-4ec0-a6f2-cac34ea737cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:19.655952 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3da5e368-b579-4a9d-b1b2-b9626bbd84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:19.795914 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 853/1721] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:38:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:19.798294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664f7dd-0735-4200-8b0a-dfb73265dd01 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:19.798963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664f7dd-0735-4200-8b0a-dfb73265dd01 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:19.800384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664f7dd-0735-4200-8b0a-dfb73265dd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:19.872443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 869/1722] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:19.880391 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ccb41-2821-4ec0-a6f2-cac34ea737cb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:19.881254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1664f7dd-0735-4200-8b0a-dfb73265dd01 None None] MFA Rules not processed for user `d7acb3eed80e47818d8b83ef68529a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:19.882568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1664f7dd-0735-4200-8b0a-dfb73265dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:20.000344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ccb41-2821-4ec0-a6f2-cac34ea737cb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:20.009897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 854/1723] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:20.014948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664f7dd-0735-4200-8b0a-dfb73265dd01 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:20.015063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ecfb2-e26c-4a94-9d37-169434cc818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:20.016595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ecfb2-e26c-4a94-9d37-169434cc818a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:20.017226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ecfb2-e26c-4a94-9d37-169434cc818a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:20.018093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1664f7dd-0735-4200-8b0a-dfb73265dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:20.018653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ecfb2-e26c-4a94-9d37-169434cc818a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:20.021856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ecfb2-e26c-4a94-9d37-169434cc818a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:20.024102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ecfb2-e26c-4a94-9d37-169434cc818a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:20.040006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 870/1724] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:20.041837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664f7dd-0735-4200-8b0a-dfb73265dd01 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:20.045108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656a567-d946-4989-8850-96f8db07635b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:20.045418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656a567-d946-4989-8850-96f8db07635b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:20.045698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656a567-d946-4989-8850-96f8db07635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:20.049092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:20.050063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:20.050493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:20.051012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] PATH_INFO: `/v3/users/60f38452c3e44615beac0be295d0a696` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:20.052458 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f38452c3e44615beac0be295d0a696)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:20.054687 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:20.102107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9656a567-d946-4989-8850-96f8db07635b None None] MFA Rules not processed for user `a3c7e6f82acd45488412439dccb933f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:20.104447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9656a567-d946-4989-8850-96f8db07635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:20.251616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 871/1725] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:20.252507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656a567-d946-4989-8850-96f8db07635b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:20.254533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9656a567-d946-4989-8850-96f8db07635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:20.280267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656a567-d946-4989-8850-96f8db07635b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:20.283707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f38452c3e44615beac0be295d0a696'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:20.284396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10f7ad-e6a1-4096-8cdd-bfec09f705ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:20.285043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f7ad-e6a1-4096-8cdd-bfec09f705ca service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:20.285352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f7ad-e6a1-4096-8cdd-bfec09f705ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:20.285628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f7ad-e6a1-4096-8cdd-bfec09f705ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:20.295496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10f7ad-e6a1-4096-8cdd-bfec09f705ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:20.296757 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10f7ad-e6a1-4096-8cdd-bfec09f705ca service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:20.308703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 872/1726] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:20.312804 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10f7ad-e6a1-4096-8cdd-bfec09f705ca service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:20.325334 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10f7ad-e6a1-4096-8cdd-bfec09f705ca service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:20.330369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973f836-6d6e-4dd1-b56e-6f52d662eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:20.331140 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973f836-6d6e-4dd1-b56e-6f52d662eca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:20.331540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973f836-6d6e-4dd1-b56e-6f52d662eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:20.331984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973f836-6d6e-4dd1-b56e-6f52d662eca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:20.334867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973f836-6d6e-4dd1-b56e-6f52d662eca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:20.336926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973f836-6d6e-4dd1-b56e-6f52d662eca2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:20.398412 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f38452c3e44615beac0be295d0a696'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:20.399127 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:20.400036 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f38452c3e44615beac0be295d0a696'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:20.401593 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f38452c3e44615beac0be295d0a696'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:20.421970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f38452c3e44615beac0be295d0a696'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:20.441647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 855/1727] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:20 2022] DELETE /identity/v3/users/60f38452c3e44615beac0be295d0a696 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:20.442838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:20.444596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:20.464359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 873/1728] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:20 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:20.467002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533616f-ce7a-49f4-895a-9670a4d4437f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:20.467439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533616f-ce7a-49f4-895a-9670a4d4437f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:20.479482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533616f-ce7a-49f4-895a-9670a4d4437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:20.552387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f533616f-ce7a-49f4-895a-9670a4d4437f None None] MFA Rules not processed for user `a3c7e6f82acd45488412439dccb933f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:20.556190 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f533616f-ce7a-49f4-895a-9670a4d4437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:20.602651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b40fae-091b-460f-b3c2-2de4edab27b0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:20.758657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dd9c5-4445-4987-80d3-5a8b0ce0d820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:20.759407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd9c5-4445-4987-80d3-5a8b0ce0d820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:20.760671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd9c5-4445-4987-80d3-5a8b0ce0d820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:20.760789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 874/1729] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:20.760880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dd9c5-4445-4987-80d3-5a8b0ce0d820 admin admin] PATH_INFO: `/v3/projects/a6ff1fe17af24407b85b82465e32cbfe/users/2f402e7c835b40249bb8e47fb209aa8a/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:20.762309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44374c-9305-4c6f-b838-c76a8ed19050 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:20.762602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44374c-9305-4c6f-b838-c76a8ed19050 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:20.762888 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44374c-9305-4c6f-b838-c76a8ed19050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:20.791643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dd9c5-4445-4987-80d3-5a8b0ce0d820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ff1fe17af24407b85b82465e32cbfe, user_id=2f402e7c835b40249bb8e47fb209aa8a, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:20.796621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dd9c5-4445-4987-80d3-5a8b0ce0d820 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:20.820366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5f44374c-9305-4c6f-b838-c76a8ed19050 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:20.821690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5f44374c-9305-4c6f-b838-c76a8ed19050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:20.830432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 875/1730] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:20.831299 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44374c-9305-4c6f-b838-c76a8ed19050 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:20.832583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5f44374c-9305-4c6f-b838-c76a8ed19050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:20.847712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44374c-9305-4c6f-b838-c76a8ed19050 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:20.857049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95520516-5a2e-4f1b-90c2-82bc60afe152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:20.857852 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95520516-5a2e-4f1b-90c2-82bc60afe152 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:20.858142 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95520516-5a2e-4f1b-90c2-82bc60afe152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:20.858414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95520516-5a2e-4f1b-90c2-82bc60afe152 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:20.859096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95520516-5a2e-4f1b-90c2-82bc60afe152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:20.861229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95520516-5a2e-4f1b-90c2-82bc60afe152 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:20.881039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 856/1731] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:20 2022] PUT /identity/v3/projects/a6ff1fe17af24407b85b82465e32cbfe/users/2f402e7c835b40249bb8e47fb209aa8a/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:20.883876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dd9c5-4445-4987-80d3-5a8b0ce0d820 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:20.889436 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9d7dd9c5-4445-4987-80d3-5a8b0ce0d820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:20.894578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:21.026048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 876/1732] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:20 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:21.029169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95520516-5a2e-4f1b-90c2-82bc60afe152 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:21.029659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-95520516-5a2e-4f1b-90c2-82bc60afe152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:21.092677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dd9c5-4445-4987-80d3-5a8b0ce0d820 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:21.109103 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab2487-0e88-4b7e-939c-242622d82da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:21.109963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2487-0e88-4b7e-939c-242622d82da4 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:21.110244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2487-0e88-4b7e-939c-242622d82da4 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:21.114610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2487-0e88-4b7e-939c-242622d82da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:21.116788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0cab2487-0e88-4b7e-939c-242622d82da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:21.216552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95520516-5a2e-4f1b-90c2-82bc60afe152 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:21.278040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab2487-0e88-4b7e-939c-242622d82da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:21.280271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab2487-0e88-4b7e-939c-242622d82da4 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:21.299050 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 857/1733] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:21.301723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fd1ec-bee9-444a-a15e-303c80919c7d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:21.301840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fd1ec-bee9-444a-a15e-303c80919c7d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:21.302110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fd1ec-bee9-444a-a15e-303c80919c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:21.320749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a10d16-650c-4543-a85d-5e7e662db54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:21.321446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a10d16-650c-4543-a85d-5e7e662db54c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:21.323853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a10d16-650c-4543-a85d-5e7e662db54c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:21.323853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a10d16-650c-4543-a85d-5e7e662db54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:21.366331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b94fd1ec-bee9-444a-a15e-303c80919c7d None None] MFA Rules not processed for user `2f402e7c835b40249bb8e47fb209aa8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:21.366823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b94fd1ec-bee9-444a-a15e-303c80919c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:21.368882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:21.464003 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a10d16-650c-4543-a85d-5e7e662db54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:21.465496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a10d16-650c-4543-a85d-5e7e662db54c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:21.501392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 877/1734] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:21.502954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a10d16-650c-4543-a85d-5e7e662db54c service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:21.518358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a10d16-650c-4543-a85d-5e7e662db54c service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:21.519619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 858/1735] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:21.523991 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fd1ec-bee9-444a-a15e-303c80919c7d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:21.529949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed36be9-3a7c-4302-abb6-13f0f0a24967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:21.531023 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed36be9-3a7c-4302-abb6-13f0f0a24967 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:21.532212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed36be9-3a7c-4302-abb6-13f0f0a24967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:21.532696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed36be9-3a7c-4302-abb6-13f0f0a24967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:21.533633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed36be9-3a7c-4302-abb6-13f0f0a24967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:21.537494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed36be9-3a7c-4302-abb6-13f0f0a24967 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:21.542228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fd1ec-bee9-444a-a15e-303c80919c7d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:21.555784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1862d-eedf-4667-aaf7-99d29ed0cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:21.556201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1862d-eedf-4667-aaf7-99d29ed0cadf admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:21.556643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1862d-eedf-4667-aaf7-99d29ed0cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:21.556750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 878/1736] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:21.556905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1862d-eedf-4667-aaf7-99d29ed0cadf admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:21.557722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1862d-eedf-4667-aaf7-99d29ed0cadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:21.557826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed36be9-3a7c-4302-abb6-13f0f0a24967 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:21.560614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1862d-eedf-4667-aaf7-99d29ed0cadf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:21.569651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed36be9-3a7c-4302-abb6-13f0f0a24967 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:21.575331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e8389-9a2b-4091-8da6-c8b1bdf3899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:21.576081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e8389-9a2b-4091-8da6-c8b1bdf3899e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:21.576368 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e8389-9a2b-4091-8da6-c8b1bdf3899e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:21.577000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e8389-9a2b-4091-8da6-c8b1bdf3899e admin admin] PATH_INFO: `/v3/projects/385626cfae6f45858e9aeae98f51b2af/users/737dffaa22514c40a955430d2c694ee2/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:21.599569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e8389-9a2b-4091-8da6-c8b1bdf3899e admin admin] RBAC: Authorizing `identity:create_grant(project_id=385626cfae6f45858e9aeae98f51b2af, user_id=737dffaa22514c40a955430d2c694ee2, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:21.602510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e8389-9a2b-4091-8da6-c8b1bdf3899e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:21.711059 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 879/1737] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:21 2022] PUT /identity/v3/projects/385626cfae6f45858e9aeae98f51b2af/users/737dffaa22514c40a955430d2c694ee2/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:21.711305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 859/1738] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:21 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:21.713280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e8389-9a2b-4091-8da6-c8b1bdf3899e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:21.714979 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1862d-eedf-4667-aaf7-99d29ed0cadf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:21.868661 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e8389-9a2b-4091-8da6-c8b1bdf3899e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:21.906718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1862d-eedf-4667-aaf7-99d29ed0cadf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:21.922242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff700036-4a45-4aa5-9756-dc16970b961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:21.923286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff700036-4a45-4aa5-9756-dc16970b961a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:21.923670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff700036-4a45-4aa5-9756-dc16970b961a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:21.924056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff700036-4a45-4aa5-9756-dc16970b961a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:21.924843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff700036-4a45-4aa5-9756-dc16970b961a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:21.929662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff700036-4a45-4aa5-9756-dc16970b961a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:21.983286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733fe6e-eb96-42f1-aad5-710518ef4ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:21.984203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733fe6e-eb96-42f1-aad5-710518ef4ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:21.984925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733fe6e-eb96-42f1-aad5-710518ef4ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:21.984925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733fe6e-eb96-42f1-aad5-710518ef4ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:21.985928 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733fe6e-eb96-42f1-aad5-710518ef4ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:21.987778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733fe6e-eb96-42f1-aad5-710518ef4ea7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:22.006616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 880/1739] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:22.008958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80267-2e26-460b-bdf0-81dfec4b9cf0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.009462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80267-2e26-460b-bdf0-81dfec4b9cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.010399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80267-2e26-460b-bdf0-81dfec4b9cf0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.013034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 881/1740] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 05:38:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:38:22.014128 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec80267-2e26-460b-bdf0-81dfec4b9cf0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:22.039764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec80267-2e26-460b-bdf0-81dfec4b9cf0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:22.050390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 860/1741] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:21 2022] POST /identity/v3/users => generated 292 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:22.051660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1b38d-75fd-48ce-a1c7-50c12827000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:22.054479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a4607-2ff1-4d83-a276-0b1425ae5ff6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.054479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a4607-2ff1-4d83-a276-0b1425ae5ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.054650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1b38d-75fd-48ce-a1c7-50c12827000e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.054722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a4607-2ff1-4d83-a276-0b1425ae5ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.054806 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1b38d-75fd-48ce-a1c7-50c12827000e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.054806 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1b38d-75fd-48ce-a1c7-50c12827000e admin admin] PATH_INFO: `/v3/projects/385626cfae6f45858e9aeae98f51b2af/users/737dffaa22514c40a955430d2c694ee2/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.056018 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1b38d-75fd-48ce-a1c7-50c12827000e admin admin] RBAC: Authorizing `identity:create_grant(project_id=385626cfae6f45858e9aeae98f51b2af, user_id=737dffaa22514c40a955430d2c694ee2, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:22.062694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1b38d-75fd-48ce-a1c7-50c12827000e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:22.091014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-663a4607-2ff1-4d83-a276-0b1425ae5ff6 None None] MFA Rules not processed for user `a5593bc41bce41b4b44616c355976cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:22.092851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-663a4607-2ff1-4d83-a276-0b1425ae5ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:22.094465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 882/1742] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:22 2022] PUT /identity/v3/projects/385626cfae6f45858e9aeae98f51b2af/users/737dffaa22514c40a955430d2c694ee2/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:22.103123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1b38d-75fd-48ce-a1c7-50c12827000e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:22.259710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:22.331186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1b38d-75fd-48ce-a1c7-50c12827000e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:22.348005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 861/1743] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 05:38:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:22.349587 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a8303-5ab5-4d02-bb94-3988773a9f1d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.350041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a8303-5ab5-4d02-bb94-3988773a9f1d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.350458 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a8303-5ab5-4d02-bb94-3988773a9f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.359545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f754fe-aa3c-4924-8185-0acc87304f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:22.365619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f754fe-aa3c-4924-8185-0acc87304f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.365619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f754fe-aa3c-4924-8185-0acc87304f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.365619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f754fe-aa3c-4924-8185-0acc87304f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.365619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f754fe-aa3c-4924-8185-0acc87304f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:22.370711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f754fe-aa3c-4924-8185-0acc87304f86 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:22.385758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:22.429102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 883/1744] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:22.429102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53c80c-ec86-445e-8393-0523b6ac7cf0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.429102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53c80c-ec86-445e-8393-0523b6ac7cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.429102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53c80c-ec86-445e-8393-0523b6ac7cf0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.431085 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-510a8303-5ab5-4d02-bb94-3988773a9f1d None None] MFA Rules not processed for user `737dffaa22514c40a955430d2c694ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:22.432496 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-510a8303-5ab5-4d02-bb94-3988773a9f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:22.443743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 884/1745] 10.222.0.42 () {54 vars in 961 bytes} [Thu Jul 28 05:38:22 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:38:22.446277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53c80c-ec86-445e-8393-0523b6ac7cf0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:22.482272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53c80c-ec86-445e-8393-0523b6ac7cf0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:22.495356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d84109-2d00-4995-9d4c-bdbb6bba9645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:22.495977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d84109-2d00-4995-9d4c-bdbb6bba9645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.496241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d84109-2d00-4995-9d4c-bdbb6bba9645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.496526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d84109-2d00-4995-9d4c-bdbb6bba9645 admin admin] PATH_INFO: `/v3/projects/73112afa51404a8393fb65d45da07b32/users/fd67c15081a24d149c1218a99d1a062a/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.539714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d84109-2d00-4995-9d4c-bdbb6bba9645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73112afa51404a8393fb65d45da07b32, user_id=fd67c15081a24d149c1218a99d1a062a, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:22.546486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d84109-2d00-4995-9d4c-bdbb6bba9645 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:22.557711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 862/1746] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:22.559112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b9732-e78b-43ff-bb0d-65dd64c005b2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.559398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b9732-e78b-43ff-bb0d-65dd64c005b2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.561252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b9732-e78b-43ff-bb0d-65dd64c005b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.593270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-161b9732-e78b-43ff-bb0d-65dd64c005b2 None None] MFA Rules not processed for user `a5593bc41bce41b4b44616c355976cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:22.594593 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-161b9732-e78b-43ff-bb0d-65dd64c005b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:22.609987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 863/1747] 10.222.0.42 () {58 vars in 1058 bytes} [Thu Jul 28 05:38:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:22.611112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b9732-e78b-43ff-bb0d-65dd64c005b2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:22.612831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-161b9732-e78b-43ff-bb0d-65dd64c005b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:22.628592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b9732-e78b-43ff-bb0d-65dd64c005b2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:22.634379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c118b-81d4-4714-90fd-7b5ca1ba708e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5593bc41bce41b4b44616c355976cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:22.635852 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c118b-81d4-4714-90fd-7b5ca1ba708e service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.636318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c118b-81d4-4714-90fd-7b5ca1ba708e service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.636732 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c118b-81d4-4714-90fd-7b5ca1ba708e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.639037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a96c118b-81d4-4714-90fd-7b5ca1ba708e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:22.644662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 885/1748] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:22 2022] PUT /identity/v3/projects/73112afa51404a8393fb65d45da07b32/users/fd67c15081a24d149c1218a99d1a062a/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:22.645318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d84109-2d00-4995-9d4c-bdbb6bba9645 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:22.652182 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-49d84109-2d00-4995-9d4c-bdbb6bba9645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:22.653933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c118b-81d4-4714-90fd-7b5ca1ba708e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:22.655925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c118b-81d4-4714-90fd-7b5ca1ba708e service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:22.682760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 864/1749] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:22.685803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e10b0b-ed79-4b42-ab52-6cb6c3a288f2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.686282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e10b0b-ed79-4b42-ab52-6cb6c3a288f2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.686733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e10b0b-ed79-4b42-ab52-6cb6c3a288f2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.694407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 865/1750] 10.222.0.42 () {54 vars in 912 bytes} [Thu Jul 28 05:38:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:38:22.695492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e10b0b-ed79-4b42-ab52-6cb6c3a288f2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:22.788796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d84109-2d00-4995-9d4c-bdbb6bba9645 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:22.795340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee06e6-b72f-4323-8773-122a17bdef45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:22.798275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee06e6-b72f-4323-8773-122a17bdef45 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.798275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee06e6-b72f-4323-8773-122a17bdef45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.798275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee06e6-b72f-4323-8773-122a17bdef45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.801111 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-58ee06e6-b72f-4323-8773-122a17bdef45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:22.857940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e10b0b-ed79-4b42-ab52-6cb6c3a288f2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:22.876238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37926a4-2340-4ff3-a81c-b25341329f39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5593bc41bce41b4b44616c355976cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:22.877608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37926a4-2340-4ff3-a81c-b25341329f39 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:22.877608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37926a4-2340-4ff3-a81c-b25341329f39 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:22.879243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37926a4-2340-4ff3-a81c-b25341329f39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:22.897169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37926a4-2340-4ff3-a81c-b25341329f39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:22.899567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37926a4-2340-4ff3-a81c-b25341329f39 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:22.913991 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 866/1751] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:22.914926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37926a4-2340-4ff3-a81c-b25341329f39 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:22.964215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee06e6-b72f-4323-8773-122a17bdef45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:22.965777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee06e6-b72f-4323-8773-122a17bdef45 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:22.987815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:22.998337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 886/1752] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:23.000954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccbe0d-ed6d-48db-9316-55de13e96ab3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:23.001273 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccbe0d-ed6d-48db-9316-55de13e96ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:23.001550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccbe0d-ed6d-48db-9316-55de13e96ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:23.087501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c1ccbe0d-ed6d-48db-9316-55de13e96ab3 None None] MFA Rules not processed for user `76596e04e82b43cb8b68ee2f5e6dd9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:23.089457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c1ccbe0d-ed6d-48db-9316-55de13e96ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:23.107635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37926a4-2340-4ff3-a81c-b25341329f39 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:23.118854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b75c7-0c72-4666-b4ad-d107ee69d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:23.121299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b75c7-0c72-4666-b4ad-d107ee69d24c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:23.121948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b75c7-0c72-4666-b4ad-d107ee69d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:23.122414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b75c7-0c72-4666-b4ad-d107ee69d24c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:23.123453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b75c7-0c72-4666-b4ad-d107ee69d24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:23.142916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b75c7-0c72-4666-b4ad-d107ee69d24c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:23.181357 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 867/1753] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:23.185264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aba4e-f748-451c-884a-dc7b083c6c9d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:23.185624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aba4e-f748-451c-884a-dc7b083c6c9d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:23.185970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aba4e-f748-451c-884a-dc7b083c6c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:23.203555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 887/1754] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:38:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:23.210601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8c5aba4e-f748-451c-884a-dc7b083c6c9d None None] MFA Rules not processed for user `69a74a81980947d9a2499a4d9ad65823`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:23.211387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccbe0d-ed6d-48db-9316-55de13e96ab3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:23.212603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8c5aba4e-f748-451c-884a-dc7b083c6c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:23.231715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccbe0d-ed6d-48db-9316-55de13e96ab3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:23.235684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:23.246157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4cc1c-067a-43a7-8ac9-c4081ba48783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:23.248184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cc1c-067a-43a7-8ac9-c4081ba48783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:23.251529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cc1c-067a-43a7-8ac9-c4081ba48783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:23.251921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cc1c-067a-43a7-8ac9-c4081ba48783 admin admin] PATH_INFO: `/v3/projects/73112afa51404a8393fb65d45da07b32/users/fd67c15081a24d149c1218a99d1a062a/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:23.257914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4cc1c-067a-43a7-8ac9-c4081ba48783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73112afa51404a8393fb65d45da07b32, user_id=fd67c15081a24d149c1218a99d1a062a, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:23.268976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4cc1c-067a-43a7-8ac9-c4081ba48783 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:23.327485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 888/1755] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:23 2022] PUT /identity/v3/projects/73112afa51404a8393fb65d45da07b32/users/fd67c15081a24d149c1218a99d1a062a/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:23.329808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a384-c149-4181-a2c3-6d86de5689cd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:23.330221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a384-c149-4181-a2c3-6d86de5689cd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:23.330586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a384-c149-4181-a2c3-6d86de5689cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:23.350541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 868/1756] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:23.351477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aba4e-f748-451c-884a-dc7b083c6c9d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:23.376754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1902a384-c149-4181-a2c3-6d86de5689cd None None] MFA Rules not processed for user `fd67c15081a24d149c1218a99d1a062a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:23.376754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1902a384-c149-4181-a2c3-6d86de5689cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:23.399410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aba4e-f748-451c-884a-dc7b083c6c9d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:23.543022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1ad1-fba0-4525-b995-064a9fa13da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:23.543022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1ad1-fba0-4525-b995-064a9fa13da3 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:23.543022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1ad1-fba0-4525-b995-064a9fa13da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:23.543340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1ad1-fba0-4525-b995-064a9fa13da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:23.558400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb1ad1-fba0-4525-b995-064a9fa13da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:23.560694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb1ad1-fba0-4525-b995-064a9fa13da3 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:23.567459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 889/1757] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:23.584839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 869/1758] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:23.596910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902a384-c149-4181-a2c3-6d86de5689cd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:23.603194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1902a384-c149-4181-a2c3-6d86de5689cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:23.730696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902a384-c149-4181-a2c3-6d86de5689cd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:23.734546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd5dc0-10f1-4fd4-a201-8d2c4e74d20f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:23.735311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd5dc0-10f1-4fd4-a201-8d2c4e74d20f service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:23.735901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd5dc0-10f1-4fd4-a201-8d2c4e74d20f service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:23.736135 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd5dc0-10f1-4fd4-a201-8d2c4e74d20f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:23.750236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd5dc0-10f1-4fd4-a201-8d2c4e74d20f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:23.751869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd5dc0-10f1-4fd4-a201-8d2c4e74d20f service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:23.764985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 890/1759] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:24.136115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1ad1-fba0-4525-b995-064a9fa13da3 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:24.155169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1ad1-fba0-4525-b995-064a9fa13da3 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:24.172102 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a09cf-fe21-4fdf-a4d8-b923d8356aa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:24.173401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a09cf-fe21-4fdf-a4d8-b923d8356aa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:24.176423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a09cf-fe21-4fdf-a4d8-b923d8356aa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:24.176719 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a09cf-fe21-4fdf-a4d8-b923d8356aa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:24.227084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd5dc0-10f1-4fd4-a201-8d2c4e74d20f service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:24.229479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-27cd5dc0-10f1-4fd4-a201-8d2c4e74d20f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:24.302096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a09cf-fe21-4fdf-a4d8-b923d8356aa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:24.304082 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a09cf-fe21-4fdf-a4d8-b923d8356aa9 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:24.327686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 870/1760] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:24.342710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a09cf-fe21-4fdf-a4d8-b923d8356aa9 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:24.353012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad5a09cf-fe21-4fdf-a4d8-b923d8356aa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:24.514552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd5dc0-10f1-4fd4-a201-8d2c4e74d20f service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:24.524803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:24.526447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:24.526996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:24.527257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] PATH_INFO: `/v3/users/1660a27f6de0471b9105b73f3d3dcd1a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:24.530782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1660a27f6de0471b9105b73f3d3dcd1a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:24.535257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:24.551997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:24.589609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a09cf-fe21-4fdf-a4d8-b923d8356aa9 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:24.604254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:24.605236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:24.605717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:24.606133 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] PATH_INFO: `/v3/projects/e156fc5d64d64880869f41883afcbef3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:24.609388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e156fc5d64d64880869f41883afcbef3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:24.619596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:24.702422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:24.814443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e156fc5d64d64880869f41883afcbef3', 'request_id': 'req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.821652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1660a27f6de0471b9105b73f3d3dcd1a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.824348 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1660a27f6de0471b9105b73f3d3dcd1a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.831641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e156fc5d64d64880869f41883afcbef3', 'request_id': 'req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.856636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e156fc5d64d64880869f41883afcbef3', 'request_id': 'req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.940270 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1660a27f6de0471b9105b73f3d3dcd1a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.941222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1660a27f6de0471b9105b73f3d3dcd1a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:24.974694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1660a27f6de0471b9105b73f3d3dcd1a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:25.016751 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 891/1761] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:24 2022] DELETE /identity/v3/users/1660a27f6de0471b9105b73f3d3dcd1a => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:25.038394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] The token cache is being invalidate because project e156fc5d64d64880869f41883afcbef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:25.042009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:25.045576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:25.047497 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 871/1762] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:24 2022] DELETE /identity/v3/projects/e156fc5d64d64880869f41883afcbef3 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:25.052209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:25.054722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:25.136177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:25.138933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:25.256164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77a92-3f82-45d5-8a32-d15b7e1f9ab9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:25.371885 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af16af-4da0-4534-bf64-d0832cc8cea8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:25.383926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3da7a6-49c3-44ac-ae0c-a19ac47d05e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:25.385814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3da7a6-49c3-44ac-ae0c-a19ac47d05e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.386281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3da7a6-49c3-44ac-ae0c-a19ac47d05e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.386794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3da7a6-49c3-44ac-ae0c-a19ac47d05e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.388982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eb3da7a6-49c3-44ac-ae0c-a19ac47d05e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:25.394058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b26ede-69f7-43e6-bd71-c9504343c779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:25.396601 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b26ede-69f7-43e6-bd71-c9504343c779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.401463 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b26ede-69f7-43e6-bd71-c9504343c779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.401908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b26ede-69f7-43e6-bd71-c9504343c779 admin admin] PATH_INFO: `/v3/users/03701ec3a333406d8c82e770489ce501` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.408179 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b26ede-69f7-43e6-bd71-c9504343c779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03701ec3a333406d8c82e770489ce501)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:25.410381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b26ede-69f7-43e6-bd71-c9504343c779 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:25.522649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3da7a6-49c3-44ac-ae0c-a19ac47d05e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:25.524317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3da7a6-49c3-44ac-ae0c-a19ac47d05e9 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:25.600860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 872/1763] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:25.607491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b0f3-fd95-4ada-b06a-881b2af001ad None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:25.609503 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b0f3-fd95-4ada-b06a-881b2af001ad None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:25.610005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b0f3-fd95-4ada-b06a-881b2af001ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:25.720505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-85b3b0f3-fd95-4ada-b06a-881b2af001ad None None] MFA Rules not processed for user `9b14f38f371b405f915a7a9ba8c61569`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:25.722398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-85b3b0f3-fd95-4ada-b06a-881b2af001ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:25.830051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17b26ede-69f7-43e6-bd71-c9504343c779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03701ec3a333406d8c82e770489ce501'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:25.832266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17b26ede-69f7-43e6-bd71-c9504343c779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03701ec3a333406d8c82e770489ce501'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:25.979960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17b26ede-69f7-43e6-bd71-c9504343c779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03701ec3a333406d8c82e770489ce501'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:25.981119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17b26ede-69f7-43e6-bd71-c9504343c779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03701ec3a333406d8c82e770489ce501'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:25.992063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 873/1764] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:26.000547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3b0f3-fd95-4ada-b06a-881b2af001ad None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:26.011924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-85b3b0f3-fd95-4ada-b06a-881b2af001ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:26.029571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17b26ede-69f7-43e6-bd71-c9504343c779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03701ec3a333406d8c82e770489ce501'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:26.062843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3b0f3-fd95-4ada-b06a-881b2af001ad None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:26.082706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 892/1765] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:25 2022] DELETE /identity/v3/users/03701ec3a333406d8c82e770489ce501 => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:26.323901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:26.324484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:26.324766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:26.325039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] PATH_INFO: `/v3/projects/d50d9081dd704537925ac55e09eb529c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:26.329048 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50d9081dd704537925ac55e09eb529c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:26.331508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:26.495632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322fc70-6ae8-4c64-a4de-3dff2671eefb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:26.495962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322fc70-6ae8-4c64-a4de-3dff2671eefb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:26.496196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322fc70-6ae8-4c64-a4de-3dff2671eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:26.539186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:26.560696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3322fc70-6ae8-4c64-a4de-3dff2671eefb None None] MFA Rules not processed for user `e728ae311b604bbcaf41f91562bffbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:26.564561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3322fc70-6ae8-4c64-a4de-3dff2671eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:26.580371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50d9081dd704537925ac55e09eb529c', 'request_id': 'req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:26.599966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50d9081dd704537925ac55e09eb529c', 'request_id': 'req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:26.623861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50d9081dd704537925ac55e09eb529c', 'request_id': 'req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:26.717012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 893/1766] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:26.747797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:26.755051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] The token cache is being invalidate because project d50d9081dd704537925ac55e09eb529c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:26.755672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:26.756474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:26.758127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 874/1767] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:25 2022] DELETE /identity/v3/projects/d50d9081dd704537925ac55e09eb529c => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:26.762477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322fc70-6ae8-4c64-a4de-3dff2671eefb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:26.764654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3322fc70-6ae8-4c64-a4de-3dff2671eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:27.019328 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322fc70-6ae8-4c64-a4de-3dff2671eefb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:27.040499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd02d32-12d9-4666-a28c-234ad048cf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:27.041869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd02d32-12d9-4666-a28c-234ad048cf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:27.044730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd02d32-12d9-4666-a28c-234ad048cf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:27.049657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd02d32-12d9-4666-a28c-234ad048cf0d admin admin] PATH_INFO: `/v3/users/c2a440a6d89f427dbb05cca5e91820af` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:27.053814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd02d32-12d9-4666-a28c-234ad048cf0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a440a6d89f427dbb05cca5e91820af)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:27.056113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd02d32-12d9-4666-a28c-234ad048cf0d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:27.471732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dcd02d32-12d9-4666-a28c-234ad048cf0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a440a6d89f427dbb05cca5e91820af'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:27.474103 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dcd02d32-12d9-4666-a28c-234ad048cf0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a440a6d89f427dbb05cca5e91820af'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:27.582518 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:27.589601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:27.656541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0242d9a-d9ef-4367-b0f0-25ed61f0bdcc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:27.700733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:27.705515 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:27.707401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:27.712925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dcd02d32-12d9-4666-a28c-234ad048cf0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a440a6d89f427dbb05cca5e91820af'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:27.714717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dcd02d32-12d9-4666-a28c-234ad048cf0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a440a6d89f427dbb05cca5e91820af'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:27.737660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] PATH_INFO: `/v3/projects/05fe4886cb514096b4af338f25f89515` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:27.760581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fe4886cb514096b4af338f25f89515)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:27.768973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:27.782027 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dcd02d32-12d9-4666-a28c-234ad048cf0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a440a6d89f427dbb05cca5e91820af'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:27.831703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 894/1768] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:26 2022] DELETE /identity/v3/users/c2a440a6d89f427dbb05cca5e91820af => generated 0 bytes in 1064 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:27.998565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fe4886cb514096b4af338f25f89515', 'request_id': 'req-ffa32c38-12b8-4291-a9d2-14eb29b13821'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:28.019653 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fe4886cb514096b4af338f25f89515', 'request_id': 'req-ffa32c38-12b8-4291-a9d2-14eb29b13821'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:28.044230 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fe4886cb514096b4af338f25f89515', 'request_id': 'req-ffa32c38-12b8-4291-a9d2-14eb29b13821'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:28.184282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] The token cache is being invalidate because project 05fe4886cb514096b4af338f25f89515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:28.184686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:28.192904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffa32c38-12b8-4291-a9d2-14eb29b13821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:28.194421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 875/1769] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:27 2022] DELETE /identity/v3/projects/05fe4886cb514096b4af338f25f89515 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:28.200212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b82f63-1619-4361-bb45-a92fe12d30e2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:28.200740 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b82f63-1619-4361-bb45-a92fe12d30e2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:28.200973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b82f63-1619-4361-bb45-a92fe12d30e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:28.248175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-66b82f63-1619-4361-bb45-a92fe12d30e2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:28.249843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-66b82f63-1619-4361-bb45-a92fe12d30e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:28.417459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 895/1770] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:28.424926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5db89d-6953-473e-826c-b5ea4ae03e5f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:28.425598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5db89d-6953-473e-826c-b5ea4ae03e5f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:28.426034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5db89d-6953-473e-826c-b5ea4ae03e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:28.451610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0a5db89d-6953-473e-826c-b5ea4ae03e5f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:28.455154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0a5db89d-6953-473e-826c-b5ea4ae03e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:28.475087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 876/1771] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:28.480241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b82f63-1619-4361-bb45-a92fe12d30e2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:28.494108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b82f63-1619-4361-bb45-a92fe12d30e2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:28.519134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ec3af-3419-4234-9dfd-2dfd41b26b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:28.519801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ec3af-3419-4234-9dfd-2dfd41b26b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:28.520111 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ec3af-3419-4234-9dfd-2dfd41b26b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:28.520328 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ec3af-3419-4234-9dfd-2dfd41b26b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:28.521046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ec3af-3419-4234-9dfd-2dfd41b26b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:28.521390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ec3af-3419-4234-9dfd-2dfd41b26b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:28.523019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ec3af-3419-4234-9dfd-2dfd41b26b5b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:28.550078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 896/1772] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:28.554394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5db89d-6953-473e-826c-b5ea4ae03e5f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:28.570925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5db89d-6953-473e-826c-b5ea4ae03e5f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:28.574678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af27713-b15b-4821-aa39-6704e5a78c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:28.575388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af27713-b15b-4821-aa39-6704e5a78c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:28.575672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af27713-b15b-4821-aa39-6704e5a78c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:28.575939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af27713-b15b-4821-aa39-6704e5a78c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:28.576722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af27713-b15b-4821-aa39-6704e5a78c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:28.582319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af27713-b15b-4821-aa39-6704e5a78c44 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:28.599934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ec3af-3419-4234-9dfd-2dfd41b26b5b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:28.602038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-587ec3af-3419-4234-9dfd-2dfd41b26b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:28.626579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ec3af-3419-4234-9dfd-2dfd41b26b5b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:28.639168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:28.639840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:28.640116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:28.641232 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] PATH_INFO: `/v3/projects/63822964d9d84721a902a6ac9fa9c844` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:28.642625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63822964d9d84721a902a6ac9fa9c844)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:28.645037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:28.740959 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:28.808944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 877/1773] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:28 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:28.818350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af27713-b15b-4821-aa39-6704e5a78c44 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:28.856592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63822964d9d84721a902a6ac9fa9c844', 'request_id': 'req-f77ebaac-5861-4143-a4f9-b9c5bea92841'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:28.879547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63822964d9d84721a902a6ac9fa9c844', 'request_id': 'req-f77ebaac-5861-4143-a4f9-b9c5bea92841'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:28.903693 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63822964d9d84721a902a6ac9fa9c844', 'request_id': 'req-f77ebaac-5861-4143-a4f9-b9c5bea92841'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:29.012347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] The token cache is being invalidate because project 63822964d9d84721a902a6ac9fa9c844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:29.015154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:29.017982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f77ebaac-5861-4143-a4f9-b9c5bea92841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:29.032544 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 897/1774] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:28 2022] DELETE /identity/v3/projects/63822964d9d84721a902a6ac9fa9c844 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:29.039116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a9972-f355-4cd2-a33a-9e9b343103dd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:29.041415 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a9972-f355-4cd2-a33a-9e9b343103dd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:29.042549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a9972-f355-4cd2-a33a-9e9b343103dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:29.137364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af27713-b15b-4821-aa39-6704e5a78c44 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:29.164541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da46c8-ba17-4f96-a584-bfc4da446aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:29.171674 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da46c8-ba17-4f96-a584-bfc4da446aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:29.174100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da46c8-ba17-4f96-a584-bfc4da446aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:29.174698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da46c8-ba17-4f96-a584-bfc4da446aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:29.175755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da46c8-ba17-4f96-a584-bfc4da446aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:29.183644 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da46c8-ba17-4f96-a584-bfc4da446aa2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:29.194036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c35a9972-f355-4cd2-a33a-9e9b343103dd None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:29.197780 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c35a9972-f355-4cd2-a33a-9e9b343103dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:29.301126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 878/1775] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:28 2022] POST /identity/v3/users => generated 289 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:29.304347 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3aaf5-b3c3-4ae8-9748-b3616b5ab092 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:29.304895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3aaf5-b3c3-4ae8-9748-b3616b5ab092 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:29.307475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3aaf5-b3c3-4ae8-9748-b3616b5ab092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:29.367846 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bdd3aaf5-b3c3-4ae8-9748-b3616b5ab092 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:29.370945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bdd3aaf5-b3c3-4ae8-9748-b3616b5ab092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:29.390772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 898/1776] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:38:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:29.404653 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 879/1777] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:29.405169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a9972-f355-4cd2-a33a-9e9b343103dd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:29.409409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd21304-5bf4-4a26-858c-a1efdcc00aad None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:29.409837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c35a9972-f355-4cd2-a33a-9e9b343103dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:29.410590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd21304-5bf4-4a26-858c-a1efdcc00aad None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:29.412068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd21304-5bf4-4a26-858c-a1efdcc00aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:29.444435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a9972-f355-4cd2-a33a-9e9b343103dd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:29.452494 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6dd21304-5bf4-4a26-858c-a1efdcc00aad None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:29.454716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6dd21304-5bf4-4a26-858c-a1efdcc00aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:29.456274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81383a1-3b5f-4ded-8abd-5f02c11300a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:29.456918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81383a1-3b5f-4ded-8abd-5f02c11300a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:29.457388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81383a1-3b5f-4ded-8abd-5f02c11300a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:29.457876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81383a1-3b5f-4ded-8abd-5f02c11300a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:29.458844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81383a1-3b5f-4ded-8abd-5f02c11300a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:29.464237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81383a1-3b5f-4ded-8abd-5f02c11300a8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:29.465242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 880/1778] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:29.471682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd21304-5bf4-4a26-858c-a1efdcc00aad None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:29.485952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 899/1779] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:29.490048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81383a1-3b5f-4ded-8abd-5f02c11300a8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:29.492766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd21304-5bf4-4a26-858c-a1efdcc00aad None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:29.512300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5f1b3-8093-49a0-9604-459653b02eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:29.513282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5f1b3-8093-49a0-9604-459653b02eda admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:29.514207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5f1b3-8093-49a0-9604-459653b02eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:29.514318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81383a1-3b5f-4ded-8abd-5f02c11300a8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:29.514850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5f1b3-8093-49a0-9604-459653b02eda admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:29.515925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5f1b3-8093-49a0-9604-459653b02eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:29.516477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5f1b3-8093-49a0-9604-459653b02eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:29.518550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5f1b3-8093-49a0-9604-459653b02eda admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:29.541902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0382621-74d2-4c24-8f08-e2153efbbf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:29.542290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 881/1780] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:38:29.542714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0382621-74d2-4c24-8f08-e2153efbbf47 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:29.542999 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0382621-74d2-4c24-8f08-e2153efbbf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:29.543274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0382621-74d2-4c24-8f08-e2153efbbf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:29.543975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0382621-74d2-4c24-8f08-e2153efbbf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:29.545717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0382621-74d2-4c24-8f08-e2153efbbf47 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:29.546835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5f1b3-8093-49a0-9604-459653b02eda admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:29.597152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5f1b3-8093-49a0-9604-459653b02eda admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:29.599623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 900/1781] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:38:29.604494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0382621-74d2-4c24-8f08-e2153efbbf47 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:29.614970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206a0e0-93a5-47ae-a80d-ffb5c1240bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:29.615616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206a0e0-93a5-47ae-a80d-ffb5c1240bde admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:29.615900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206a0e0-93a5-47ae-a80d-ffb5c1240bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:29.616174 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206a0e0-93a5-47ae-a80d-ffb5c1240bde admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:29.619888 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206a0e0-93a5-47ae-a80d-ffb5c1240bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:29.621770 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0382621-74d2-4c24-8f08-e2153efbbf47 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:29.627411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206a0e0-93a5-47ae-a80d-ffb5c1240bde admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:29.627690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f6d4a-af29-4a1e-bbd7-b16abd8e1e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:29.628309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f6d4a-af29-4a1e-bbd7-b16abd8e1e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:29.628625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f6d4a-af29-4a1e-bbd7-b16abd8e1e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:29.628851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f6d4a-af29-4a1e-bbd7-b16abd8e1e19 admin admin] PATH_INFO: `/v3/projects/f75201ad5f644b0faa081104647f86cd/users/34e078fb72d74f83ac06c46cb31cc101/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:29.654224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f6d4a-af29-4a1e-bbd7-b16abd8e1e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75201ad5f644b0faa081104647f86cd, user_id=34e078fb72d74f83ac06c46cb31cc101, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:29.659495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f6d4a-af29-4a1e-bbd7-b16abd8e1e19 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:29.710274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:29.835318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 901/1782] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:29 2022] PUT /identity/v3/projects/f75201ad5f644b0faa081104647f86cd/users/34e078fb72d74f83ac06c46cb31cc101/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:29.837175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80294d22-07d9-46a1-bb65-83528927f75c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:29.838290 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80294d22-07d9-46a1-bb65-83528927f75c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:29.838754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80294d22-07d9-46a1-bb65-83528927f75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:29.881762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 882/1783] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:29 2022] POST /identity/v3/projects => generated 371 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:29.882710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206a0e0-93a5-47ae-a80d-ffb5c1240bde admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:29.891934 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a206a0e0-93a5-47ae-a80d-ffb5c1240bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:29.893530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-80294d22-07d9-46a1-bb65-83528927f75c None None] MFA Rules not processed for user `34e078fb72d74f83ac06c46cb31cc101`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:29.895906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-80294d22-07d9-46a1-bb65-83528927f75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:29.974280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:30.081059 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 902/1784] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:30.086602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80294d22-07d9-46a1-bb65-83528927f75c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:30.238171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206a0e0-93a5-47ae-a80d-ffb5c1240bde admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:30.249608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67ab47-7659-483c-b813-002856caf878 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:30.250642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ab47-7659-483c-b813-002856caf878 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:30.251068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ab47-7659-483c-b813-002856caf878 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:30.251745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ab47-7659-483c-b813-002856caf878 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:30.329932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80294d22-07d9-46a1-bb65-83528927f75c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:30.355505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32c312-ad42-4b71-a10b-e2e6743f6ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:30.357018 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32c312-ad42-4b71-a10b-e2e6743f6ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:30.360081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32c312-ad42-4b71-a10b-e2e6743f6ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:30.360464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32c312-ad42-4b71-a10b-e2e6743f6ebc admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:30.362257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32c312-ad42-4b71-a10b-e2e6743f6ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:30.371229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32c312-ad42-4b71-a10b-e2e6743f6ebc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:30.509605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67ab47-7659-483c-b813-002856caf878 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:30.513589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 903/1785] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:30 2022] POST /identity/v3/users => generated 286 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:30.519060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32c312-ad42-4b71-a10b-e2e6743f6ebc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:30.522828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67ab47-7659-483c-b813-002856caf878 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:30.570230 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 883/1786] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:38:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:38:30.571259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67ab47-7659-483c-b813-002856caf878 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:30.573187 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32c312-ad42-4b71-a10b-e2e6743f6ebc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:30.588081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7f9e5-2340-4fc2-b7bc-bd787c9c4014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:30.589633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f9e5-2340-4fc2-b7bc-bd787c9c4014 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:30.591478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f9e5-2340-4fc2-b7bc-bd787c9c4014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:30.592371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f9e5-2340-4fc2-b7bc-bd787c9c4014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:30.593441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7f9e5-2340-4fc2-b7bc-bd787c9c4014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:30.602346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7f9e5-2340-4fc2-b7bc-bd787c9c4014 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:30.614799 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67ab47-7659-483c-b813-002856caf878 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:30.636590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754b8de-c34a-4bb5-ae54-fd1dcb26c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:30.638165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754b8de-c34a-4bb5-ae54-fd1dcb26c9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:30.638473 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754b8de-c34a-4bb5-ae54-fd1dcb26c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:30.638746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754b8de-c34a-4bb5-ae54-fd1dcb26c9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:30.639481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754b8de-c34a-4bb5-ae54-fd1dcb26c9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:30.647906 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754b8de-c34a-4bb5-ae54-fd1dcb26c9e6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:30.669456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 884/1787] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:30.671232 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb2b29-1d7b-44cb-902d-da4b3c09c30f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:30.671711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb2b29-1d7b-44cb-902d-da4b3c09c30f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:30.672743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb2b29-1d7b-44cb-902d-da4b3c09c30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:30.699013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e9bb2b29-1d7b-44cb-902d-da4b3c09c30f None None] MFA Rules not processed for user `76596e04e82b43cb8b68ee2f5e6dd9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:30.700923 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e9bb2b29-1d7b-44cb-902d-da4b3c09c30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:30.784403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 904/1788] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:30 2022] POST /identity/v3/projects => generated 381 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:30.785480 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7f9e5-2340-4fc2-b7bc-bd787c9c4014 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:30.874769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 885/1789] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jul 28 05:38:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:30.878166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb2b29-1d7b-44cb-902d-da4b3c09c30f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:30.935180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb2b29-1d7b-44cb-902d-da4b3c09c30f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:31.040048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7f9e5-2340-4fc2-b7bc-bd787c9c4014 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:31.046974 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2c0b1-b409-4614-b66f-5ecc97b13211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:31.048030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2c0b1-b409-4614-b66f-5ecc97b13211 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:31.048513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2c0b1-b409-4614-b66f-5ecc97b13211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:31.049005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2c0b1-b409-4614-b66f-5ecc97b13211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:31.050000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2c0b1-b409-4614-b66f-5ecc97b13211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:31.052737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2c0b1-b409-4614-b66f-5ecc97b13211 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:31.068009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 905/1790] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:31.069910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2c0b1-b409-4614-b66f-5ecc97b13211 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:31.073847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d6c2c0b1-b409-4614-b66f-5ecc97b13211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:31.214469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6a70d-4c93-40ca-8de9-c8a080f03767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:31.215753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6a70d-4c93-40ca-8de9-c8a080f03767 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:31.216202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6a70d-4c93-40ca-8de9-c8a080f03767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:31.217653 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6a70d-4c93-40ca-8de9-c8a080f03767 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:31.218734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6a70d-4c93-40ca-8de9-c8a080f03767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:31.232467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2c0b1-b409-4614-b66f-5ecc97b13211 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:31.239105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:31.248148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6f252-85b5-471e-9757-6bb5cef08e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:31.251312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f252-85b5-471e-9757-6bb5cef08e84 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:31.252119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6a70d-4c93-40ca-8de9-c8a080f03767 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:31.252616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f252-85b5-471e-9757-6bb5cef08e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:31.253091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f252-85b5-471e-9757-6bb5cef08e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:31.276235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6f252-85b5-471e-9757-6bb5cef08e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:31.287641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6f252-85b5-471e-9757-6bb5cef08e84 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:31.328353 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 906/1791] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:31.330008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6f252-85b5-471e-9757-6bb5cef08e84 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:31.362396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6f252-85b5-471e-9757-6bb5cef08e84 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:31.386167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7607dad-f96c-4efc-afae-a89ed98b0c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:31.386167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7607dad-f96c-4efc-afae-a89ed98b0c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:31.386167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7607dad-f96c-4efc-afae-a89ed98b0c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:31.386167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7607dad-f96c-4efc-afae-a89ed98b0c49 admin admin] PATH_INFO: `/v3/projects/33be882d8cfe432db4a77a7bf7d389ff/users/451a90b709ed4477aaa0352859da2479/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:31.388866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 886/1792] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:30 2022] POST /identity/v3/users => generated 297 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:31.395715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6a70d-4c93-40ca-8de9-c8a080f03767 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:31.424197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7607dad-f96c-4efc-afae-a89ed98b0c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33be882d8cfe432db4a77a7bf7d389ff, user_id=451a90b709ed4477aaa0352859da2479, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:31.428869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7607dad-f96c-4efc-afae-a89ed98b0c49 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:31.440520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6a70d-4c93-40ca-8de9-c8a080f03767 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:31.469146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa970-cd9b-46e4-a985-7edd8bbecfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:31.470860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa970-cd9b-46e4-a985-7edd8bbecfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:31.471146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa970-cd9b-46e4-a985-7edd8bbecfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:31.471415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa970-cd9b-46e4-a985-7edd8bbecfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:31.475828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa970-cd9b-46e4-a985-7edd8bbecfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:31.486133 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa970-cd9b-46e4-a985-7edd8bbecfd5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:31.526139 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 887/1793] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:31.535837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa970-cd9b-46e4-a985-7edd8bbecfd5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:31.539913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 907/1794] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:31 2022] PUT /identity/v3/projects/33be882d8cfe432db4a77a7bf7d389ff/users/451a90b709ed4477aaa0352859da2479/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:31.551428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf981722-11e7-4a40-a451-8e81faf6d7d1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:31.551700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf981722-11e7-4a40-a451-8e81faf6d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:31.553107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf981722-11e7-4a40-a451-8e81faf6d7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:31.563840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa970-cd9b-46e4-a985-7edd8bbecfd5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:31.637800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bf981722-11e7-4a40-a451-8e81faf6d7d1 None None] MFA Rules not processed for user `451a90b709ed4477aaa0352859da2479`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:31.642203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bf981722-11e7-4a40-a451-8e81faf6d7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:31.773386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061beaec-5500-4555-85c8-761009709e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:31.773386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061beaec-5500-4555-85c8-761009709e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:31.773386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061beaec-5500-4555-85c8-761009709e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:31.773386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061beaec-5500-4555-85c8-761009709e28 admin admin] PATH_INFO: `/v3/projects/0ec05358cd234bf1a1a823ed31c3c745/users/ae5be17aae4f497389b49ac5eb44fcbd/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:31.840083 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061beaec-5500-4555-85c8-761009709e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec05358cd234bf1a1a823ed31c3c745, user_id=ae5be17aae4f497389b49ac5eb44fcbd, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:31.843536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061beaec-5500-4555-85c8-761009709e28 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:31.855685 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 908/1795] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:31.856683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf981722-11e7-4a40-a451-8e81faf6d7d1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:31.858755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bf981722-11e7-4a40-a451-8e81faf6d7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:31.876745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf981722-11e7-4a40-a451-8e81faf6d7d1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:31.892330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:31.893087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:31.893331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:31.893592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] PATH_INFO: `/v3/users/d7acb3eed80e47818d8b83ef68529a7e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:31.896712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7acb3eed80e47818d8b83ef68529a7e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:31.902019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:31.973209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 888/1796] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:31 2022] PUT /identity/v3/projects/0ec05358cd234bf1a1a823ed31c3c745/users/ae5be17aae4f497389b49ac5eb44fcbd/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:31.975092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061beaec-5500-4555-85c8-761009709e28 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:32.307867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061beaec-5500-4555-85c8-761009709e28 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:32.307867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7551f-d507-4b81-91a9-3ae08fb01136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:32.307867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7551f-d507-4b81-91a9-3ae08fb01136 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:32.307867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7551f-d507-4b81-91a9-3ae08fb01136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:32.308945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7551f-d507-4b81-91a9-3ae08fb01136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:32.308945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7551f-d507-4b81-91a9-3ae08fb01136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:32.308945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7551f-d507-4b81-91a9-3ae08fb01136 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:32.443272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7acb3eed80e47818d8b83ef68529a7e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:32.443272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7acb3eed80e47818d8b83ef68529a7e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:32.519846 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 889/1797] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:31 2022] POST /identity/v3/projects => generated 371 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:32.524707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7551f-d507-4b81-91a9-3ae08fb01136 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:32.740258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7acb3eed80e47818d8b83ef68529a7e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:32.741383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7acb3eed80e47818d8b83ef68529a7e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:32.750048 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7551f-d507-4b81-91a9-3ae08fb01136 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:32.766970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7acb3eed80e47818d8b83ef68529a7e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:32.781165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71ea77-760a-4ae5-8199-f6e7c3d38947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:32.783804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ea77-760a-4ae5-8199-f6e7c3d38947 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:32.783804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ea77-760a-4ae5-8199-f6e7c3d38947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:32.783804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ea77-760a-4ae5-8199-f6e7c3d38947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:32.784949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71ea77-760a-4ae5-8199-f6e7c3d38947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:32.789315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71ea77-760a-4ae5-8199-f6e7c3d38947 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:32.795166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 909/1798] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:31 2022] DELETE /identity/v3/users/d7acb3eed80e47818d8b83ef68529a7e => generated 0 bytes in 939 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:32.799797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:32.801697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:32.825617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 890/1799] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:32.828322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2824c6-324c-44e9-a949-151919a9cb91 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:32.828598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2824c6-324c-44e9-a949-151919a9cb91 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:32.836330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2824c6-324c-44e9-a949-151919a9cb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:32.884948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9b2824c6-324c-44e9-a949-151919a9cb91 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:32.886157 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9b2824c6-324c-44e9-a949-151919a9cb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:33.084362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c187c8-37f9-490f-a506-929af9395328 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:33.099854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 891/1800] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:33.100681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2824c6-324c-44e9-a949-151919a9cb91 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:33.102520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9b2824c6-324c-44e9-a949-151919a9cb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:33.119731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bb56a-a1b6-4356-8bf3-5b0fd41381b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:33.119731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bb56a-a1b6-4356-8bf3-5b0fd41381b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:33.119731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bb56a-a1b6-4356-8bf3-5b0fd41381b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:33.119731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bb56a-a1b6-4356-8bf3-5b0fd41381b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:33.121264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bb56a-a1b6-4356-8bf3-5b0fd41381b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:33.121264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bb56a-a1b6-4356-8bf3-5b0fd41381b2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:33.121425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2824c6-324c-44e9-a949-151919a9cb91 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:33.188274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0226-c404-4183-8f3c-028b81677ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:33.189997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0226-c404-4183-8f3c-028b81677ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:33.190278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0226-c404-4183-8f3c-028b81677ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:33.190562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0226-c404-4183-8f3c-028b81677ac1 admin admin] PATH_INFO: `/v3/projects/0ec05358cd234bf1a1a823ed31c3c745/users/ae5be17aae4f497389b49ac5eb44fcbd/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:33.198953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a0226-c404-4183-8f3c-028b81677ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec05358cd234bf1a1a823ed31c3c745, user_id=ae5be17aae4f497389b49ac5eb44fcbd, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:33.218522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a0226-c404-4183-8f3c-028b81677ac1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:33.240861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 910/1801] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:32 2022] POST /identity/v3/users => generated 292 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:33.241879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bb56a-a1b6-4356-8bf3-5b0fd41381b2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:33.246441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-876bb56a-a1b6-4356-8bf3-5b0fd41381b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:33.264921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 892/1802] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:33 2022] PUT /identity/v3/projects/0ec05358cd234bf1a1a823ed31c3c745/users/ae5be17aae4f497389b49ac5eb44fcbd/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:33.274987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0226-c404-4183-8f3c-028b81677ac1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:33.389473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:33.510775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bb56a-a1b6-4356-8bf3-5b0fd41381b2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:33.599808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0226-c404-4183-8f3c-028b81677ac1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:33.619549 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929492e-10e2-4ee5-9791-da180b24ac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:33.622901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929492e-10e2-4ee5-9791-da180b24ac9e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:33.623195 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7606c9-f9b1-4a9b-930c-c46a7fc5981c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:33.623333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929492e-10e2-4ee5-9791-da180b24ac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:33.623459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929492e-10e2-4ee5-9791-da180b24ac9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:33.623847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7606c9-f9b1-4a9b-930c-c46a7fc5981c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:33.624133 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7606c9-f9b1-4a9b-930c-c46a7fc5981c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:33.624254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929492e-10e2-4ee5-9791-da180b24ac9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:33.624408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7606c9-f9b1-4a9b-930c-c46a7fc5981c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:33.629510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929492e-10e2-4ee5-9791-da180b24ac9e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:33.663109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 893/1803] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:33.668331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b9b76-6524-47e2-bc5f-6a4259f24d8a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:33.668664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b9b76-6524-47e2-bc5f-6a4259f24d8a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:33.669067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b9b76-6524-47e2-bc5f-6a4259f24d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:33.686749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7606c9-f9b1-4a9b-930c-c46a7fc5981c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:33.688236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7606c9-f9b1-4a9b-930c-c46a7fc5981c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:33.746944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 911/1804] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:33.747933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7606c9-f9b1-4a9b-930c-c46a7fc5981c service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:33.782454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7606c9-f9b1-4a9b-930c-c46a7fc5981c service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:33.790145 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b62b9b76-6524-47e2-bc5f-6a4259f24d8a None None] MFA Rules not processed for user `ae5be17aae4f497389b49ac5eb44fcbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:33.795213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b7adc-fb9e-4525-aa55-2b5e0afec079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:33.796079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7adc-fb9e-4525-aa55-2b5e0afec079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:33.796356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7adc-fb9e-4525-aa55-2b5e0afec079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:33.796636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7adc-fb9e-4525-aa55-2b5e0afec079 admin admin] PATH_INFO: `/v3/projects/d279a08e75a348a287032b09439b1823/users/e53566ede56547468553525688844a56/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:33.810513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b62b9b76-6524-47e2-bc5f-6a4259f24d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:33.871352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b7adc-fb9e-4525-aa55-2b5e0afec079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d279a08e75a348a287032b09439b1823, user_id=e53566ede56547468553525688844a56, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:33.882242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b7adc-fb9e-4525-aa55-2b5e0afec079 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:33.974321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 912/1805] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:33 2022] PUT /identity/v3/projects/d279a08e75a348a287032b09439b1823/users/e53566ede56547468553525688844a56/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:33.980730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b7adc-fb9e-4525-aa55-2b5e0afec079 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:34.056942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 894/1806] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:34.075775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b9b76-6524-47e2-bc5f-6a4259f24d8a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:34.077299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b62b9b76-6524-47e2-bc5f-6a4259f24d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:34.239927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b7adc-fb9e-4525-aa55-2b5e0afec079 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:34.262699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964a378-700e-4589-8ab9-37e64170c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:34.263355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a378-700e-4589-8ab9-37e64170c60f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:34.264814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a378-700e-4589-8ab9-37e64170c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:34.265107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964a378-700e-4589-8ab9-37e64170c60f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:34.265911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964a378-700e-4589-8ab9-37e64170c60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:34.267555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964a378-700e-4589-8ab9-37e64170c60f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:34.341598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 913/1807] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:34.344584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b9b76-6524-47e2-bc5f-6a4259f24d8a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:34.348498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964a378-700e-4589-8ab9-37e64170c60f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:34.388956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964a378-700e-4589-8ab9-37e64170c60f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:34.423460 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd19be-6bbb-45c4-988a-3bc0da0204a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:34.430909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd19be-6bbb-45c4-988a-3bc0da0204a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:34.431362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd19be-6bbb-45c4-988a-3bc0da0204a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:34.431798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd19be-6bbb-45c4-988a-3bc0da0204a0 admin admin] PATH_INFO: `/v3/projects/d279a08e75a348a287032b09439b1823/users/e53566ede56547468553525688844a56/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:34.452461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd19be-6bbb-45c4-988a-3bc0da0204a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d279a08e75a348a287032b09439b1823, user_id=e53566ede56547468553525688844a56, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:34.455195 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd19be-6bbb-45c4-988a-3bc0da0204a0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:34.513433 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 914/1808] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:34 2022] PUT /identity/v3/projects/d279a08e75a348a287032b09439b1823/users/e53566ede56547468553525688844a56/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:34.520070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e4ec4-f2ae-4abc-ad01-401314650312 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:34.520559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e4ec4-f2ae-4abc-ad01-401314650312 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:34.520986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e4ec4-f2ae-4abc-ad01-401314650312 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:34.526597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 915/1809] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 05:38:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:38:34.538093 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3def0b0-1861-4e39-88af-bd8db99fe016 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:34.538637 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3def0b0-1861-4e39-88af-bd8db99fe016 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:34.539079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3def0b0-1861-4e39-88af-bd8db99fe016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:34.546488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:34.570720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe336e1-7b35-473d-ada6-dc9c43204bcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:34.571261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe336e1-7b35-473d-ada6-dc9c43204bcc service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:34.571545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe336e1-7b35-473d-ada6-dc9c43204bcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:34.571993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe336e1-7b35-473d-ada6-dc9c43204bcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:34.675302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c3def0b0-1861-4e39-88af-bd8db99fe016 None None] MFA Rules not processed for user `e53566ede56547468553525688844a56`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:34.683639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3def0b0-1861-4e39-88af-bd8db99fe016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:34.881758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 916/1810] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:34.883430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00f48-f0c1-42cf-9d2e-abb39e86779d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:34.884475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00f48-f0c1-42cf-9d2e-abb39e86779d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:34.884911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00f48-f0c1-42cf-9d2e-abb39e86779d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:34.909381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe336e1-7b35-473d-ada6-dc9c43204bcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:34.915032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe336e1-7b35-473d-ada6-dc9c43204bcc service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:34.946900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 895/1811] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 871 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:34.970422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-15b00f48-f0c1-42cf-9d2e-abb39e86779d None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:34.971666 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-15b00f48-f0c1-42cf-9d2e-abb39e86779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:35.058506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe336e1-7b35-473d-ada6-dc9c43204bcc service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:35.075747 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe336e1-7b35-473d-ada6-dc9c43204bcc service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:35.328340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 917/1812] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 05:38:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:35.374582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a0e79-5c42-4ef6-b1f6-163f38191036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:35.378186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:35.379079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0e79-5c42-4ef6-b1f6-163f38191036 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:35.382024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0e79-5c42-4ef6-b1f6-163f38191036 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:35.384012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0e79-5c42-4ef6-b1f6-163f38191036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:35.421818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a0e79-5c42-4ef6-b1f6-163f38191036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:35.427710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a0e79-5c42-4ef6-b1f6-163f38191036 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:35.454994 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 896/1813] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:35.721520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b00f48-f0c1-42cf-9d2e-abb39e86779d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:35.723387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-15b00f48-f0c1-42cf-9d2e-abb39e86779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:35.774019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b00f48-f0c1-42cf-9d2e-abb39e86779d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:35.804763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f1fa-b679-4024-916b-c44f748da204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:35.808250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f1fa-b679-4024-916b-c44f748da204 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:35.808583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f1fa-b679-4024-916b-c44f748da204 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:35.809364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f1fa-b679-4024-916b-c44f748da204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:35.842447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4f1fa-b679-4024-916b-c44f748da204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:35.847569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4f1fa-b679-4024-916b-c44f748da204 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:35.925774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 918/1814] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:36.859967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:37.057471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a0e79-5c42-4ef6-b1f6-163f38191036 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:37.240258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a0e79-5c42-4ef6-b1f6-163f38191036 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:37.264418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae57bcb-254e-4c2a-a11a-fcb872fd0b06 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5be17aae4f497389b49ac5eb44fcbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec05358cd234bf1a1a823ed31c3c745', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:37.265110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae57bcb-254e-4c2a-a11a-fcb872fd0b06 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:37.268966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae57bcb-254e-4c2a-a11a-fcb872fd0b06 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:37.268966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae57bcb-254e-4c2a-a11a-fcb872fd0b06 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:37.268966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae57bcb-254e-4c2a-a11a-fcb872fd0b06 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:37.268966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae57bcb-254e-4c2a-a11a-fcb872fd0b06 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:37.271268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae57bcb-254e-4c2a-a11a-fcb872fd0b06 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:37.279383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:37.311767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 897/1815] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:37.316256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f1fa-b679-4024-916b-c44f748da204 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:37.334426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f1fa-b679-4024-916b-c44f748da204 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:37.365327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9835c-9a82-42fa-9a09-08df73eebd61 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5be17aae4f497389b49ac5eb44fcbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec05358cd234bf1a1a823ed31c3c745', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:37.366614 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9835c-9a82-42fa-9a09-08df73eebd61 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:37.367500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9835c-9a82-42fa-9a09-08df73eebd61 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:37.367860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9835c-9a82-42fa-9a09-08df73eebd61 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:37.370935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9835c-9a82-42fa-9a09-08df73eebd61 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:37.378097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9835c-9a82-42fa-9a09-08df73eebd61 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:37.549685 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 919/1816] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:37 2022] POST /identity/v3/projects => generated 352 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:37.553982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae57bcb-254e-4c2a-a11a-fcb872fd0b06 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:37.576482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae57bcb-254e-4c2a-a11a-fcb872fd0b06 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:37.611976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9835c-9a82-42fa-9a09-08df73eebd61 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:37.721065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9835c-9a82-42fa-9a09-08df73eebd61 tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:37.727548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b762279-6dad-4cbc-a59d-c9dcd391558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:37.729571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762279-6dad-4cbc-a59d-c9dcd391558a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:37.730085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762279-6dad-4cbc-a59d-c9dcd391558a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:37.730568 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b762279-6dad-4cbc-a59d-c9dcd391558a admin admin] PATH_INFO: `/v3/users/451a90b709ed4477aaa0352859da2479` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:37.732054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b762279-6dad-4cbc-a59d-c9dcd391558a admin admin] RBAC: Authorizing `identity:delete_user(user_id=451a90b709ed4477aaa0352859da2479)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:37.734294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b762279-6dad-4cbc-a59d-c9dcd391558a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:37.754474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53655db-5c81-4492-827d-0d88cefe330f tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5be17aae4f497389b49ac5eb44fcbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec05358cd234bf1a1a823ed31c3c745', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:37.757384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53655db-5c81-4492-827d-0d88cefe330f tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:37.757725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53655db-5c81-4492-827d-0d88cefe330f tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:37.759713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53655db-5c81-4492-827d-0d88cefe330f tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:37.763179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53655db-5c81-4492-827d-0d88cefe330f tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:37.763571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53655db-5c81-4492-827d-0d88cefe330f tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:37.776131 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53655db-5c81-4492-827d-0d88cefe330f tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:37.794635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 898/1817] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:38:37.883351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53655db-5c81-4492-827d-0d88cefe330f tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:37.941559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53655db-5c81-4492-827d-0d88cefe330f tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:37.960571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5be17aae4f497389b49ac5eb44fcbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec05358cd234bf1a1a823ed31c3c745', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:37.964073 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:37.967254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:37.967868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] PATH_INFO: `/v3/projects/36b74acf93de4decaabb96dd1500f34f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:37.970711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: Authorizing `identity:delete_project(project_id=36b74acf93de4decaabb96dd1500f34f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:37.975591 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:38.187973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b762279-6dad-4cbc-a59d-c9dcd391558a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451a90b709ed4477aaa0352859da2479'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.187973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b762279-6dad-4cbc-a59d-c9dcd391558a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451a90b709ed4477aaa0352859da2479'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.196262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b74acf93de4decaabb96dd1500f34f', 'request_id': 'req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.219121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b74acf93de4decaabb96dd1500f34f', 'request_id': 'req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.230119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b74acf93de4decaabb96dd1500f34f', 'request_id': 'req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.266028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b762279-6dad-4cbc-a59d-c9dcd391558a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451a90b709ed4477aaa0352859da2479'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.267603 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b762279-6dad-4cbc-a59d-c9dcd391558a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451a90b709ed4477aaa0352859da2479'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.304732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b762279-6dad-4cbc-a59d-c9dcd391558a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451a90b709ed4477aaa0352859da2479'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.333074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 920/1818] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:37 2022] DELETE /identity/v3/users/451a90b709ed4477aaa0352859da2479 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:38.338132 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61dc7-f4a1-4226-bcde-3635801846d9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:38.338756 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61dc7-f4a1-4226-bcde-3635801846d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:38.339044 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf61dc7-f4a1-4226-bcde-3635801846d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:38.370846 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6bf61dc7-f4a1-4226-bcde-3635801846d9 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:38.373364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6bf61dc7-f4a1-4226-bcde-3635801846d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:38.380259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] The token cache is being invalidate because project 36b74acf93de4decaabb96dd1500f34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:38.381498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.382778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.396900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 899/1819] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:37 2022] DELETE /identity/v3/projects/36b74acf93de4decaabb96dd1500f34f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:38.434939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:38.436422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:38.489509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 921/1820] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:38.605069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf61dc7-f4a1-4226-bcde-3635801846d9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:38.610300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6bf61dc7-f4a1-4226-bcde-3635801846d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:38.629806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3448a6d-6b8d-4232-9a9f-b17ae43515cf tempest-VolumeQuotaClassesTest-2097695786 tempest-VolumeQuotaClassesTest-2097695786-project-admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:38.636454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:38.637300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:38.637649 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:38.637993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] PATH_INFO: `/v3/projects/c0366200688f46b9b2cc801e230093b7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:38.639285 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0366200688f46b9b2cc801e230093b7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:38.641522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:38.767048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf61dc7-f4a1-4226-bcde-3635801846d9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:38.779576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e5766-0221-4a60-9122-3094dbae063e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:38.781243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e5766-0221-4a60-9122-3094dbae063e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:38.789695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e5766-0221-4a60-9122-3094dbae063e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:38.789695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e5766-0221-4a60-9122-3094dbae063e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:38.808103 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e5766-0221-4a60-9122-3094dbae063e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:38.809561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e5766-0221-4a60-9122-3094dbae063e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:38.818776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0366200688f46b9b2cc801e230093b7', 'request_id': 'req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.827538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 922/1821] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:38.832155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0366200688f46b9b2cc801e230093b7', 'request_id': 'req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.851712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0366200688f46b9b2cc801e230093b7', 'request_id': 'req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.974848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] The token cache is being invalidate because project c0366200688f46b9b2cc801e230093b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:38.974848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.985281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:38.995063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e5766-0221-4a60-9122-3094dbae063e service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:39.005712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 900/1822] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:38 2022] DELETE /identity/v3/projects/c0366200688f46b9b2cc801e230093b7 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:39.014997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e5766-0221-4a60-9122-3094dbae063e service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:39.230350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669c800-5b81-4043-951d-42b726771cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:39.233353 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669c800-5b81-4043-951d-42b726771cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:39.233646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669c800-5b81-4043-951d-42b726771cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:39.233928 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669c800-5b81-4043-951d-42b726771cf7 admin admin] PATH_INFO: `/v3/users/737dffaa22514c40a955430d2c694ee2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:39.245560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669c800-5b81-4043-951d-42b726771cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737dffaa22514c40a955430d2c694ee2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:39.257205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669c800-5b81-4043-951d-42b726771cf7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:39.500573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:39.502222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:39.526299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46a8fc-893a-428b-bc42-94e3ff5f8dbe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:39.545632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:39.546323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:39.546609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:39.546890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] PATH_INFO: `/v3/users/34e078fb72d74f83ac06c46cb31cc101` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:39.558270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e078fb72d74f83ac06c46cb31cc101)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:39.561282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:39.619687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d669c800-5b81-4043-951d-42b726771cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737dffaa22514c40a955430d2c694ee2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:39.621259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d669c800-5b81-4043-951d-42b726771cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737dffaa22514c40a955430d2c694ee2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:39.624755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:39.732340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d669c800-5b81-4043-951d-42b726771cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737dffaa22514c40a955430d2c694ee2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:39.733664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d669c800-5b81-4043-951d-42b726771cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737dffaa22514c40a955430d2c694ee2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:39.793719 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d669c800-5b81-4043-951d-42b726771cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737dffaa22514c40a955430d2c694ee2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:39.817668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e078fb72d74f83ac06c46cb31cc101'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:39.843672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 923/1823] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:38 2022] DELETE /identity/v3/users/737dffaa22514c40a955430d2c694ee2 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:39.865067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:39.891617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e078fb72d74f83ac06c46cb31cc101'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:39.892615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e078fb72d74f83ac06c46cb31cc101'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:39.893475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e078fb72d74f83ac06c46cb31cc101'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:39.914600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e078fb72d74f83ac06c46cb31cc101'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:39.936191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 901/1824] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:39 2022] DELETE /identity/v3/users/34e078fb72d74f83ac06c46cb31cc101 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:39.936329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794dcc1-69bc-450f-907c-d27134caa1af None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:39.936329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794dcc1-69bc-450f-907c-d27134caa1af None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:39.936528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794dcc1-69bc-450f-907c-d27134caa1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:39.982011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7794dcc1-69bc-450f-907c-d27134caa1af None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:39.983928 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7794dcc1-69bc-450f-907c-d27134caa1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:40.096533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 924/1825] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:40.161267 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:40.161267 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:40.271304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc041b-17f4-4452-9b0c-d4b55cb6b30b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:40.277589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659b406-b0ad-4d93-aa8e-f239e7449cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:40.278452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b406-b0ad-4d93-aa8e-f239e7449cbb service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:40.278740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b406-b0ad-4d93-aa8e-f239e7449cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:40.279010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659b406-b0ad-4d93-aa8e-f239e7449cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:40.299883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659b406-b0ad-4d93-aa8e-f239e7449cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:40.303685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659b406-b0ad-4d93-aa8e-f239e7449cbb service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:40.349095 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 902/1826] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:40.443065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:40.487984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09b6b8-fa0f-4071-a56a-bb07af3c9c4a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:40.488280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09b6b8-fa0f-4071-a56a-bb07af3c9c4a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:40.488618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09b6b8-fa0f-4071-a56a-bb07af3c9c4a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:40.490643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 925/1827] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 05:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:38:40.544616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd562c42-3e8a-4184-a472-2255ef9e6b10 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:40.544616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd562c42-3e8a-4184-a472-2255ef9e6b10 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:40.544616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd562c42-3e8a-4184-a472-2255ef9e6b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:40.593315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cd562c42-3e8a-4184-a472-2255ef9e6b10 None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:40.598482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cd562c42-3e8a-4184-a472-2255ef9e6b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:40.793782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 903/1828] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 05:38:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:40.869648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09b6b8-fa0f-4071-a56a-bb07af3c9c4a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:40.871979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a09b6b8-fa0f-4071-a56a-bb07af3c9c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:40.892481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09b6b8-fa0f-4071-a56a-bb07af3c9c4a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:40.902040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa86e75-c739-48e0-a98d-81604c6faae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:40.902902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa86e75-c739-48e0-a98d-81604c6faae9 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:40.903346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa86e75-c739-48e0-a98d-81604c6faae9 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:40.903766 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa86e75-c739-48e0-a98d-81604c6faae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:40.920802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa86e75-c739-48e0-a98d-81604c6faae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:40.928523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa86e75-c739-48e0-a98d-81604c6faae9 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:40.967500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 926/1829] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:42.356561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd562c42-3e8a-4184-a472-2255ef9e6b10 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:42.359933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cd562c42-3e8a-4184-a472-2255ef9e6b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:42.397811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd562c42-3e8a-4184-a472-2255ef9e6b10 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:42.414524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:42.418394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:42.419544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:42.420138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] PATH_INFO: `/v3/projects/33be882d8cfe432db4a77a7bf7d389ff` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:42.423008 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=33be882d8cfe432db4a77a7bf7d389ff)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:42.425877 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:42.901983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa86e75-c739-48e0-a98d-81604c6faae9 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:42.904822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3aa86e75-c739-48e0-a98d-81604c6faae9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:42.930242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33be882d8cfe432db4a77a7bf7d389ff', 'request_id': 'req-10748040-9dbd-4f10-9cc3-ae83b799f7fb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:42.939113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa86e75-c739-48e0-a98d-81604c6faae9 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:42.941352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33be882d8cfe432db4a77a7bf7d389ff', 'request_id': 'req-10748040-9dbd-4f10-9cc3-ae83b799f7fb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:42.950101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33be882d8cfe432db4a77a7bf7d389ff', 'request_id': 'req-10748040-9dbd-4f10-9cc3-ae83b799f7fb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.035242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] The token cache is being invalidate because project 33be882d8cfe432db4a77a7bf7d389ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:43.043885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.043885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.046889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 904/1830] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:42 2022] DELETE /identity/v3/projects/33be882d8cfe432db4a77a7bf7d389ff => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:43.048040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:43.048718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:43.049594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:43.050883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:43.051731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:43.052175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] PATH_INFO: `/v3/projects/f75201ad5f644b0faa081104647f86cd` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:43.054837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75201ad5f644b0faa081104647f86cd)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:43.058687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:43.096181 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10748040-9dbd-4f10-9cc3-ae83b799f7fb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:43.107205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:43.108156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:43.108654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:43.109077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] PATH_INFO: `/v3/projects/385626cfae6f45858e9aeae98f51b2af` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:43.111059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=385626cfae6f45858e9aeae98f51b2af)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:43.113233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:43.245901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75201ad5f644b0faa081104647f86cd', 'request_id': 'req-583c2b88-94c6-4a06-8366-5ff83b22e98f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.283713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75201ad5f644b0faa081104647f86cd', 'request_id': 'req-583c2b88-94c6-4a06-8366-5ff83b22e98f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.309283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75201ad5f644b0faa081104647f86cd', 'request_id': 'req-583c2b88-94c6-4a06-8366-5ff83b22e98f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.312950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385626cfae6f45858e9aeae98f51b2af', 'request_id': 'req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.333255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385626cfae6f45858e9aeae98f51b2af', 'request_id': 'req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.355977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385626cfae6f45858e9aeae98f51b2af', 'request_id': 'req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.445962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] The token cache is being invalidate because project f75201ad5f644b0faa081104647f86cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:43.446168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.448051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.452137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 927/1831] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:42 2022] DELETE /identity/v3/projects/f75201ad5f644b0faa081104647f86cd => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:43.467440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:43.489871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:43.560083 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] The token cache is being invalidate because project 385626cfae6f45858e9aeae98f51b2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:43.560621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.561530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:43.566821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 905/1832] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:43 2022] DELETE /identity/v3/projects/385626cfae6f45858e9aeae98f51b2af => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:43.567957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:43.576902 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:43.658106 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:43.672929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c2b88-94c6-4a06-8366-5ff83b22e98f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:43.776869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82661305-cf34-43a9-af01-318c67539f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:43.777950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82661305-cf34-43a9-af01-318c67539f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:43.778450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82661305-cf34-43a9-af01-318c67539f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:43.778938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82661305-cf34-43a9-af01-318c67539f8b admin admin] PATH_INFO: `/v3/users/e53566ede56547468553525688844a56` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:43.780617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82661305-cf34-43a9-af01-318c67539f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53566ede56547468553525688844a56)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:43.782904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82661305-cf34-43a9-af01-318c67539f8b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:43.787236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fcdc3-8e18-4c53-ae06-b35f8decd7cc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:43.794788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7260ec-cf0c-4266-bae7-c566f8c8bcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:43.795475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7260ec-cf0c-4266-bae7-c566f8c8bcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:43.795760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7260ec-cf0c-4266-bae7-c566f8c8bcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:43.796036 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7260ec-cf0c-4266-bae7-c566f8c8bcf2 admin admin] PATH_INFO: `/v3/users/ae5be17aae4f497389b49ac5eb44fcbd` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:43.797401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7260ec-cf0c-4266-bae7-c566f8c8bcf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5be17aae4f497389b49ac5eb44fcbd)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:43.799409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7260ec-cf0c-4266-bae7-c566f8c8bcf2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:43.989005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:44.013216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ca7260ec-cf0c-4266-bae7-c566f8c8bcf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5be17aae4f497389b49ac5eb44fcbd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:44.018266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-82661305-cf34-43a9-af01-318c67539f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53566ede56547468553525688844a56'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:44.019674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-82661305-cf34-43a9-af01-318c67539f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53566ede56547468553525688844a56'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:44.093199 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ca7260ec-cf0c-4266-bae7-c566f8c8bcf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5be17aae4f497389b49ac5eb44fcbd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:44.093857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ca7260ec-cf0c-4266-bae7-c566f8c8bcf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5be17aae4f497389b49ac5eb44fcbd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:44.094490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ca7260ec-cf0c-4266-bae7-c566f8c8bcf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5be17aae4f497389b49ac5eb44fcbd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:44.114119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ca7260ec-cf0c-4266-bae7-c566f8c8bcf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5be17aae4f497389b49ac5eb44fcbd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:44.133281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 906/1833] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:43 2022] DELETE /identity/v3/users/ae5be17aae4f497389b49ac5eb44fcbd => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:44.133281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9b59-912b-43da-9fdd-f41e211f3591 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:44.133281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9b59-912b-43da-9fdd-f41e211f3591 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:44.133281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9b59-912b-43da-9fdd-f41e211f3591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:44.169066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bd8d9b59-912b-43da-9fdd-f41e211f3591 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:44.170669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bd8d9b59-912b-43da-9fdd-f41e211f3591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:44.207536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-82661305-cf34-43a9-af01-318c67539f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53566ede56547468553525688844a56'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:44.208569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-82661305-cf34-43a9-af01-318c67539f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53566ede56547468553525688844a56'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:44.264767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-82661305-cf34-43a9-af01-318c67539f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53566ede56547468553525688844a56'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:44.295734 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 928/1834] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:43 2022] DELETE /identity/v3/users/e53566ede56547468553525688844a56 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:44.358518 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 907/1835] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:44.373116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ae2dc-7b95-4f48-81f3-a2aae16d122c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:44.373116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ae2dc-7b95-4f48-81f3-a2aae16d122c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:44.373116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ae2dc-7b95-4f48-81f3-a2aae16d122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:44.422291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-680ae2dc-7b95-4f48-81f3-a2aae16d122c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:44.430695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-680ae2dc-7b95-4f48-81f3-a2aae16d122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:44.551260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 929/1836] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:44.555641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d9b59-912b-43da-9fdd-f41e211f3591 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:44.566186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d9b59-912b-43da-9fdd-f41e211f3591 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:44.572999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb426346-03c3-4e32-b5c6-75e31c8fefc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:44.573917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb426346-03c3-4e32-b5c6-75e31c8fefc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:44.574447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb426346-03c3-4e32-b5c6-75e31c8fefc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:44.574958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb426346-03c3-4e32-b5c6-75e31c8fefc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:44.575873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb426346-03c3-4e32-b5c6-75e31c8fefc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:44.576354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb426346-03c3-4e32-b5c6-75e31c8fefc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:44.578333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb426346-03c3-4e32-b5c6-75e31c8fefc7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:44.627303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ae2dc-7b95-4f48-81f3-a2aae16d122c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:44.629487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 908/1837] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:44.637891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ae2dc-7b95-4f48-81f3-a2aae16d122c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:44.643266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2a01e-a427-4d89-9497-66df73a878ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:44.645933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a01e-a427-4d89-9497-66df73a878ba admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:44.645933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a01e-a427-4d89-9497-66df73a878ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:44.645933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2a01e-a427-4d89-9497-66df73a878ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:44.645933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2a01e-a427-4d89-9497-66df73a878ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:44.647144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2a01e-a427-4d89-9497-66df73a878ba admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:44.773513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 930/1838] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:44 2022] POST /identity/v3/projects => generated 391 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:44.777283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb426346-03c3-4e32-b5c6-75e31c8fefc7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:44.791275 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb426346-03c3-4e32-b5c6-75e31c8fefc7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:44.878862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae90eb-628f-4bf9-bfed-efd54cd1b37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:44.879495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae90eb-628f-4bf9-bfed-efd54cd1b37f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:44.879774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae90eb-628f-4bf9-bfed-efd54cd1b37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:44.880044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae90eb-628f-4bf9-bfed-efd54cd1b37f admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:44.880896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae90eb-628f-4bf9-bfed-efd54cd1b37f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:44.882865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae90eb-628f-4bf9-bfed-efd54cd1b37f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:44.893942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2a01e-a427-4d89-9497-66df73a878ba admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:44.895670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fdb2a01e-a427-4d89-9497-66df73a878ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:44.917337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2a01e-a427-4d89-9497-66df73a878ba admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:44.922604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:44.923259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:44.923543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:44.923863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] PATH_INFO: `/v3/projects/0ec05358cd234bf1a1a823ed31c3c745` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:44.925281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec05358cd234bf1a1a823ed31c3c745)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:44.927604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:44.984763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 909/1839] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:44 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:44.988981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae90eb-628f-4bf9-bfed-efd54cd1b37f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:44.998951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae90eb-628f-4bf9-bfed-efd54cd1b37f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:45.003767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3aed7a-a858-416d-ae0e-5e29b3e666fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:45.004380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aed7a-a858-416d-ae0e-5e29b3e666fd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.004665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aed7a-a858-416d-ae0e-5e29b3e666fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.004942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aed7a-a858-416d-ae0e-5e29b3e666fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.005870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3aed7a-a858-416d-ae0e-5e29b3e666fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:45.007491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3aed7a-a858-416d-ae0e-5e29b3e666fd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:45.023501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 910/1840] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:45.029706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3aed7a-a858-416d-ae0e-5e29b3e666fd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:45.037474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3aed7a-a858-416d-ae0e-5e29b3e666fd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:45.057322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fcbf3-c73f-4d31-9618-1770c09f49fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:45.057967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fcbf3-c73f-4d31-9618-1770c09f49fd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.058252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fcbf3-c73f-4d31-9618-1770c09f49fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.058524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fcbf3-c73f-4d31-9618-1770c09f49fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.059234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fcbf3-c73f-4d31-9618-1770c09f49fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:45.061207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fcbf3-c73f-4d31-9618-1770c09f49fd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:45.067240 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec05358cd234bf1a1a823ed31c3c745', 'request_id': 'req-010c5cd1-33e9-4710-a954-a8917b168434'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:45.079971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec05358cd234bf1a1a823ed31c3c745', 'request_id': 'req-010c5cd1-33e9-4710-a954-a8917b168434'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:45.085662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 911/1841] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:45.086638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fcbf3-c73f-4d31-9618-1770c09f49fd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:45.090471 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec05358cd234bf1a1a823ed31c3c745', 'request_id': 'req-010c5cd1-33e9-4710-a954-a8917b168434'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:45.091315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-882fcbf3-c73f-4d31-9618-1770c09f49fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:45.106513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fcbf3-c73f-4d31-9618-1770c09f49fd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:45.174411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] The token cache is being invalidate because project 0ec05358cd234bf1a1a823ed31c3c745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:45.174873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:45.177469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:45.179513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 931/1842] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:44 2022] DELETE /identity/v3/projects/0ec05358cd234bf1a1a823ed31c3c745 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:45.180587 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:45.187258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:45.221536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:45.221536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.221536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.221536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] PATH_INFO: `/v3/projects/d279a08e75a348a287032b09439b1823` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.227391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d279a08e75a348a287032b09439b1823)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:45.227391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:45.269361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c5cd1-33e9-4710-a954-a8917b168434 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:45.274198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aec0a3-82b6-4049-8178-1f62328c35fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:45.276564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aec0a3-82b6-4049-8178-1f62328c35fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.276564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aec0a3-82b6-4049-8178-1f62328c35fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.276564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aec0a3-82b6-4049-8178-1f62328c35fb admin admin] PATH_INFO: `/v3/projects/6fb355f861d3472b8a0bff142c3274f7/users/bc9c0772e5ca4709a99701dab765a9c3/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.291431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aec0a3-82b6-4049-8178-1f62328c35fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb355f861d3472b8a0bff142c3274f7, user_id=bc9c0772e5ca4709a99701dab765a9c3, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:45.294141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aec0a3-82b6-4049-8178-1f62328c35fb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:45.384441 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd279a08e75a348a287032b09439b1823', 'request_id': 'req-afff698f-a510-4d48-ad92-3e405e37ffcb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:45.386017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 932/1843] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:45 2022] PUT /identity/v3/projects/6fb355f861d3472b8a0bff142c3274f7/users/bc9c0772e5ca4709a99701dab765a9c3/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:45.387749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347db52d-50c4-481d-a67b-e40efe211325 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.388132 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347db52d-50c4-481d-a67b-e40efe211325 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.388464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347db52d-50c4-481d-a67b-e40efe211325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.397059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:45.402385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd279a08e75a348a287032b09439b1823', 'request_id': 'req-afff698f-a510-4d48-ad92-3e405e37ffcb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:45.408049 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd279a08e75a348a287032b09439b1823', 'request_id': 'req-afff698f-a510-4d48-ad92-3e405e37ffcb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:45.412008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-347db52d-50c4-481d-a67b-e40efe211325 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:45.413246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-347db52d-50c4-481d-a67b-e40efe211325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:45.498144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 933/1844] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:45.499419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d19c14-40f9-4bf3-a0e7-d58d8c535a90 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.499765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d19c14-40f9-4bf3-a0e7-d58d8c535a90 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.500048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d19c14-40f9-4bf3-a0e7-d58d8c535a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.518984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] The token cache is being invalidate because project d279a08e75a348a287032b09439b1823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:45.519500 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:45.520225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-afff698f-a510-4d48-ad92-3e405e37ffcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:45.522193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 912/1845] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:45 2022] DELETE /identity/v3/projects/d279a08e75a348a287032b09439b1823 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:45.528264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b315f-e2b5-443a-98b7-6a8f786da42c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.528660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b315f-e2b5-443a-98b7-6a8f786da42c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.529043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b315f-e2b5-443a-98b7-6a8f786da42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.533494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-26d19c14-40f9-4bf3-a0e7-d58d8c535a90 None None] MFA Rules not processed for user `bc9c0772e5ca4709a99701dab765a9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:45.534735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-26d19c14-40f9-4bf3-a0e7-d58d8c535a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:45.550505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-093b315f-e2b5-443a-98b7-6a8f786da42c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:45.551842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-093b315f-e2b5-443a-98b7-6a8f786da42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:45.561928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 913/1846] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:45.563855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd668e3-6acc-45b3-8f4b-ffa4d9aa9695 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.564947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd668e3-6acc-45b3-8f4b-ffa4d9aa9695 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.564947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd668e3-6acc-45b3-8f4b-ffa4d9aa9695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.588582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ddd668e3-6acc-45b3-8f4b-ffa4d9aa9695 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:45.589871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ddd668e3-6acc-45b3-8f4b-ffa4d9aa9695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:45.596994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:45.608156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 914/1847] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:45.608156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd668e3-6acc-45b3-8f4b-ffa4d9aa9695 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:45.612752 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd668e3-6acc-45b3-8f4b-ffa4d9aa9695 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:45.618073 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5725-f10b-4e9b-b1d7-55f5642b0666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:45.618796 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5725-f10b-4e9b-b1d7-55f5642b0666 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.619372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5725-f10b-4e9b-b1d7-55f5642b0666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.619741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5725-f10b-4e9b-b1d7-55f5642b0666 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.620544 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 934/1848] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:45.620905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5725-f10b-4e9b-b1d7-55f5642b0666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:45.621724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5725-f10b-4e9b-b1d7-55f5642b0666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:45.622195 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5757249-766a-4836-849c-640139d235f1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.622491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5757249-766a-4836-849c-640139d235f1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.622774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5757249-766a-4836-849c-640139d235f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.624321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5725-f10b-4e9b-b1d7-55f5642b0666 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:45.641194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 915/1849] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:45.642226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5725-f10b-4e9b-b1d7-55f5642b0666 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:45.645745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-81db5725-f10b-4e9b-b1d7-55f5642b0666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:45.646185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e5757249-766a-4836-849c-640139d235f1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:45.647590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e5757249-766a-4836-849c-640139d235f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:45.658129 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 935/1850] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:45.659183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5757249-766a-4836-849c-640139d235f1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:45.666884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5725-f10b-4e9b-b1d7-55f5642b0666 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:45.670140 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5757249-766a-4836-849c-640139d235f1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:45.670800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03f083-ae23-46e8-9167-b89923cfc6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:45.671459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03f083-ae23-46e8-9167-b89923cfc6ef admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.671771 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03f083-ae23-46e8-9167-b89923cfc6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.672045 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03f083-ae23-46e8-9167-b89923cfc6ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.672827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03f083-ae23-46e8-9167-b89923cfc6ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:45.674853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03f083-ae23-46e8-9167-b89923cfc6ef admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:45.675142 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c182e-d5ff-49d7-82ac-775c456bba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:45.675749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c182e-d5ff-49d7-82ac-775c456bba06 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.676033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c182e-d5ff-49d7-82ac-775c456bba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.676306 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c182e-d5ff-49d7-82ac-775c456bba06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.676981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c182e-d5ff-49d7-82ac-775c456bba06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:45.678895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c182e-d5ff-49d7-82ac-775c456bba06 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:45.793056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 936/1851] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:45 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:45.793269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 916/1852] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:45 2022] POST /identity/v3/projects => generated 391 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:45.793422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c182e-d5ff-49d7-82ac-775c456bba06 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:45.793530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03f083-ae23-46e8-9167-b89923cfc6ef admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:45.855572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03f083-ae23-46e8-9167-b89923cfc6ef admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:45.855797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c182e-d5ff-49d7-82ac-775c456bba06 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:45.860126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052405b-9e50-4bf3-af2d-b3b638ccb857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:45.860266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f3b7-7738-44fa-ac6c-31c80b8b987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:45.860818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f3b7-7738-44fa-ac6c-31c80b8b987f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.860932 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052405b-9e50-4bf3-af2d-b3b638ccb857 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.861101 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f3b7-7738-44fa-ac6c-31c80b8b987f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.861231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052405b-9e50-4bf3-af2d-b3b638ccb857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.861402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f3b7-7738-44fa-ac6c-31c80b8b987f admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.865490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052405b-9e50-4bf3-af2d-b3b638ccb857 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.865608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325f3b7-7738-44fa-ac6c-31c80b8b987f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:45.865706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052405b-9e50-4bf3-af2d-b3b638ccb857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:45.865796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325f3b7-7738-44fa-ac6c-31c80b8b987f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:45.865796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325f3b7-7738-44fa-ac6c-31c80b8b987f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:45.865944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052405b-9e50-4bf3-af2d-b3b638ccb857 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:45.876961 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 937/1853] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:45.877808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f3b7-7738-44fa-ac6c-31c80b8b987f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:45.888894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f3b7-7738-44fa-ac6c-31c80b8b987f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:45.892358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5586a-1b14-4bb8-b001-1802c804daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:45.892966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5586a-1b14-4bb8-b001-1802c804daa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.893268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5586a-1b14-4bb8-b001-1802c804daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.893545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5586a-1b14-4bb8-b001-1802c804daa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.894233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5586a-1b14-4bb8-b001-1802c804daa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:45.896140 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5586a-1b14-4bb8-b001-1802c804daa0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:45.934633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 917/1854] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:45 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:45.935904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052405b-9e50-4bf3-af2d-b3b638ccb857 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:45.945582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052405b-9e50-4bf3-af2d-b3b638ccb857 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:45.950904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405749a8-8893-4d88-b7d3-86274a4bcd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:45.951504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405749a8-8893-4d88-b7d3-86274a4bcd56 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:45.951782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405749a8-8893-4d88-b7d3-86274a4bcd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:45.952052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405749a8-8893-4d88-b7d3-86274a4bcd56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:45.952872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405749a8-8893-4d88-b7d3-86274a4bcd56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:45.954847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405749a8-8893-4d88-b7d3-86274a4bcd56 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:45.996907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 938/1855] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:45 2022] POST /identity/v3/users => generated 302 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:45.998016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5586a-1b14-4bb8-b001-1802c804daa0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.008499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5586a-1b14-4bb8-b001-1802c804daa0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.014239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35add437-5d6e-4ba1-b1e7-110c27890443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.014972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add437-5d6e-4ba1-b1e7-110c27890443 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.015263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add437-5d6e-4ba1-b1e7-110c27890443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.015536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35add437-5d6e-4ba1-b1e7-110c27890443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.016260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35add437-5d6e-4ba1-b1e7-110c27890443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.017975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35add437-5d6e-4ba1-b1e7-110c27890443 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.032228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 939/1856] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:46.032228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35add437-5d6e-4ba1-b1e7-110c27890443 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.041563 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35add437-5d6e-4ba1-b1e7-110c27890443 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.042403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:46.048636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddb74b-7171-4680-8c1e-7042c62d282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.048636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddb74b-7171-4680-8c1e-7042c62d282e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.048636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddb74b-7171-4680-8c1e-7042c62d282e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.048636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddb74b-7171-4680-8c1e-7042c62d282e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.049084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddb74b-7171-4680-8c1e-7042c62d282e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.049879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 918/1857] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:45 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:46.050725 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddb74b-7171-4680-8c1e-7042c62d282e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.050855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405749a8-8893-4d88-b7d3-86274a4bcd56 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.063106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 940/1858] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:46.064182 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddb74b-7171-4680-8c1e-7042c62d282e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.076313 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddb74b-7171-4680-8c1e-7042c62d282e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.113424 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405749a8-8893-4d88-b7d3-86274a4bcd56 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.118613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b13e70-3ce8-4a27-a0ff-236db3b187d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.119225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b13e70-3ce8-4a27-a0ff-236db3b187d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.119505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b13e70-3ce8-4a27-a0ff-236db3b187d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.119772 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b13e70-3ce8-4a27-a0ff-236db3b187d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.120465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b13e70-3ce8-4a27-a0ff-236db3b187d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.122131 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b13e70-3ce8-4a27-a0ff-236db3b187d7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.132588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 919/1859] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:46.133378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b13e70-3ce8-4a27-a0ff-236db3b187d7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.138794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09077-33e2-46e8-b453-688055b35955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.139428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09077-33e2-46e8-b453-688055b35955 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.139714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09077-33e2-46e8-b453-688055b35955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.139989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09077-33e2-46e8-b453-688055b35955 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.140648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb09077-33e2-46e8-b453-688055b35955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.142606 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb09077-33e2-46e8-b453-688055b35955 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.143179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b13e70-3ce8-4a27-a0ff-236db3b187d7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.147713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b94dcc-f884-44d8-a4d9-7781ab36a319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.148392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b94dcc-f884-44d8-a4d9-7781ab36a319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.148673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b94dcc-f884-44d8-a4d9-7781ab36a319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.148940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b94dcc-f884-44d8-a4d9-7781ab36a319 admin admin] PATH_INFO: `/v3/projects/807830b808314a4daa965992107047fc/users/e1e71f89cd564e1a98523d5f9b1a4537/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.166470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b94dcc-f884-44d8-a4d9-7781ab36a319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807830b808314a4daa965992107047fc, user_id=e1e71f89cd564e1a98523d5f9b1a4537, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.169282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b94dcc-f884-44d8-a4d9-7781ab36a319 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.273234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 941/1860] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:46 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:46.273234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09077-33e2-46e8-b453-688055b35955 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.284971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09077-33e2-46e8-b453-688055b35955 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.286880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 920/1861] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:46 2022] PUT /identity/v3/projects/807830b808314a4daa965992107047fc/users/e1e71f89cd564e1a98523d5f9b1a4537/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:46.287683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b94dcc-f884-44d8-a4d9-7781ab36a319 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.370830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a01a3-e516-4c16-a376-4267747fd613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.371524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a01a3-e516-4c16-a376-4267747fd613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.371818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a01a3-e516-4c16-a376-4267747fd613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.372093 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a01a3-e516-4c16-a376-4267747fd613 admin admin] PATH_INFO: `/v3/projects/adfb2b40b97c47548db83e4378c92ac6/users/afd95377175d423f97d8f79f5d4887e9/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.389463 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a01a3-e516-4c16-a376-4267747fd613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfb2b40b97c47548db83e4378c92ac6, user_id=afd95377175d423f97d8f79f5d4887e9, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.392287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a01a3-e516-4c16-a376-4267747fd613 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.406670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b94dcc-f884-44d8-a4d9-7781ab36a319 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.413096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359a373-defd-4d2c-acc4-a390bd6c62c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.413996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359a373-defd-4d2c-acc4-a390bd6c62c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.414493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359a373-defd-4d2c-acc4-a390bd6c62c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.414995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359a373-defd-4d2c-acc4-a390bd6c62c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.416003 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359a373-defd-4d2c-acc4-a390bd6c62c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.418576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359a373-defd-4d2c-acc4-a390bd6c62c2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.433456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 921/1862] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:46.433456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359a373-defd-4d2c-acc4-a390bd6c62c2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.444439 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359a373-defd-4d2c-acc4-a390bd6c62c2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.450087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136aa77-332c-4197-a038-0aac24a96ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.450713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136aa77-332c-4197-a038-0aac24a96ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.451183 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136aa77-332c-4197-a038-0aac24a96ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.451380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136aa77-332c-4197-a038-0aac24a96ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.452076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136aa77-332c-4197-a038-0aac24a96ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.453767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136aa77-332c-4197-a038-0aac24a96ef6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.472088 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 922/1863] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:46.472088 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136aa77-332c-4197-a038-0aac24a96ef6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.483857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136aa77-332c-4197-a038-0aac24a96ef6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.492410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da2acb-c62e-42b8-b194-1f9a54e1013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.499455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 942/1864] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:46 2022] PUT /identity/v3/projects/adfb2b40b97c47548db83e4378c92ac6/users/afd95377175d423f97d8f79f5d4887e9/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:46.500476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a01a3-e516-4c16-a376-4267747fd613 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.513375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da2acb-c62e-42b8-b194-1f9a54e1013f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.513375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da2acb-c62e-42b8-b194-1f9a54e1013f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.513375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da2acb-c62e-42b8-b194-1f9a54e1013f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.513375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da2acb-c62e-42b8-b194-1f9a54e1013f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.513375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da2acb-c62e-42b8-b194-1f9a54e1013f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.546683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 923/1865] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:46.546683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1112c-beff-4409-a078-91c8221f5f87 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.546683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1112c-beff-4409-a078-91c8221f5f87 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.546683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1112c-beff-4409-a078-91c8221f5f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.589770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-37c1112c-beff-4409-a078-91c8221f5f87 None None] MFA Rules not processed for user `afd95377175d423f97d8f79f5d4887e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:46.592841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-37c1112c-beff-4409-a078-91c8221f5f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:46.629986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a01a3-e516-4c16-a376-4267747fd613 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.636098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74b5ed-1066-4a8c-969f-5ecb53bd7725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.636986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74b5ed-1066-4a8c-969f-5ecb53bd7725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.637308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74b5ed-1066-4a8c-969f-5ecb53bd7725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.637649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74b5ed-1066-4a8c-969f-5ecb53bd7725 admin admin] PATH_INFO: `/v3/projects/807830b808314a4daa965992107047fc/users/e1e71f89cd564e1a98523d5f9b1a4537/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.640009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74b5ed-1066-4a8c-969f-5ecb53bd7725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807830b808314a4daa965992107047fc, user_id=e1e71f89cd564e1a98523d5f9b1a4537, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.642755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74b5ed-1066-4a8c-969f-5ecb53bd7725 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.659772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 943/1866] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:46 2022] PUT /identity/v3/projects/807830b808314a4daa965992107047fc/users/e1e71f89cd564e1a98523d5f9b1a4537/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:46.661082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74b5ed-1066-4a8c-969f-5ecb53bd7725 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.671641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 924/1867] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:46.673171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59eeb-ebdc-4197-925a-deae9daa75c7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.676797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59eeb-ebdc-4197-925a-deae9daa75c7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.676797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59eeb-ebdc-4197-925a-deae9daa75c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.705424 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-81d59eeb-ebdc-4197-925a-deae9daa75c7 None None] MFA Rules not processed for user `e1e71f89cd564e1a98523d5f9b1a4537`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:46.707641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-81d59eeb-ebdc-4197-925a-deae9daa75c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:46.753686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74b5ed-1066-4a8c-969f-5ecb53bd7725 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.758692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4bfcc-0f2c-4c1e-87f5-f2f63fca0671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.759641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4bfcc-0f2c-4c1e-87f5-f2f63fca0671 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.759926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4bfcc-0f2c-4c1e-87f5-f2f63fca0671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.760205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4bfcc-0f2c-4c1e-87f5-f2f63fca0671 admin admin] PATH_INFO: `/v3/projects/8f638e9ba1ad406dbff0bc2ea78b5488/users/afadb3c08dca442081738259116eac8a/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.779176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4bfcc-0f2c-4c1e-87f5-f2f63fca0671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f638e9ba1ad406dbff0bc2ea78b5488, user_id=afadb3c08dca442081738259116eac8a, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.781950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4bfcc-0f2c-4c1e-87f5-f2f63fca0671 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.790720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 925/1868] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:46.791755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d59eeb-ebdc-4197-925a-deae9daa75c7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.802862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d59eeb-ebdc-4197-925a-deae9daa75c7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.808151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c0012-21b3-4221-bb4e-76fe025f5055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.808768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c0012-21b3-4221-bb4e-76fe025f5055 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.809051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c0012-21b3-4221-bb4e-76fe025f5055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.809359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c0012-21b3-4221-bb4e-76fe025f5055 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.810141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c0012-21b3-4221-bb4e-76fe025f5055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.812238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c0012-21b3-4221-bb4e-76fe025f5055 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:46.858100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 944/1869] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:46 2022] PUT /identity/v3/projects/8f638e9ba1ad406dbff0bc2ea78b5488/users/afadb3c08dca442081738259116eac8a/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:46.859179 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4bfcc-0f2c-4c1e-87f5-f2f63fca0671 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:46.860731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e0e4bfcc-0f2c-4c1e-87f5-f2f63fca0671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:46.918532 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4bfcc-0f2c-4c1e-87f5-f2f63fca0671 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:46.923617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863b3e8-14c2-4333-adc5-fef513649e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:46.924245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863b3e8-14c2-4333-adc5-fef513649e09 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.924521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863b3e8-14c2-4333-adc5-fef513649e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.924784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863b3e8-14c2-4333-adc5-fef513649e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.931722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 926/1870] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:46 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:46.931722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c5b12-44a5-4f29-8217-a8cc01096eca None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:46.931722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c5b12-44a5-4f29-8217-a8cc01096eca None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:46.931722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c5b12-44a5-4f29-8217-a8cc01096eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:46.957109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ef7c5b12-44a5-4f29-8217-a8cc01096eca None None] MFA Rules not processed for user `afadb3c08dca442081738259116eac8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:46.958342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ef7c5b12-44a5-4f29-8217-a8cc01096eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:46.989326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863b3e8-14c2-4333-adc5-fef513649e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:46.990820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863b3e8-14c2-4333-adc5-fef513649e09 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.000787 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 945/1871] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:47.001614 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863b3e8-14c2-4333-adc5-fef513649e09 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.030636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 927/1872] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:47.035114 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c5b12-44a5-4f29-8217-a8cc01096eca None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.074159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863b3e8-14c2-4333-adc5-fef513649e09 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.087625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=3,keystone:DELETE=18,keystone:SELECT=79 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:47.111415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c5b12-44a5-4f29-8217-a8cc01096eca None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.114997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:47.116939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311adaf-1b0c-4a4e-924f-cc853b3515c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.117789 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311adaf-1b0c-4a4e-924f-cc853b3515c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.118111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311adaf-1b0c-4a4e-924f-cc853b3515c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.118392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311adaf-1b0c-4a4e-924f-cc853b3515c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.119074 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311adaf-1b0c-4a4e-924f-cc853b3515c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.123688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311adaf-1b0c-4a4e-924f-cc853b3515c5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.152033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376a330-c022-4b26-82e1-1801c64f1f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.152946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376a330-c022-4b26-82e1-1801c64f1f23 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.153083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376a330-c022-4b26-82e1-1801c64f1f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.157722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376a330-c022-4b26-82e1-1801c64f1f23 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.157722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376a330-c022-4b26-82e1-1801c64f1f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.157722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376a330-c022-4b26-82e1-1801c64f1f23 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.205761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 928/1873] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:47 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:47.205761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311adaf-1b0c-4a4e-924f-cc853b3515c5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.205761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5311adaf-1b0c-4a4e-924f-cc853b3515c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:47.268899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 946/1874] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:47 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:47.268899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376a330-c022-4b26-82e1-1801c64f1f23 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.275278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311adaf-1b0c-4a4e-924f-cc853b3515c5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.285760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376a330-c022-4b26-82e1-1801c64f1f23 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.285970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a4d21-2797-4d42-a7ec-36aaa548081b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.287105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4d21-2797-4d42-a7ec-36aaa548081b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.288357 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4d21-2797-4d42-a7ec-36aaa548081b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.288806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a4d21-2797-4d42-a7ec-36aaa548081b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.361906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b9c69-f8d2-4c91-b2cd-f904c5960738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.368119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b9c69-f8d2-4c91-b2cd-f904c5960738 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.368119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b9c69-f8d2-4c91-b2cd-f904c5960738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.368119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b9c69-f8d2-4c91-b2cd-f904c5960738 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.368393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a4d21-2797-4d42-a7ec-36aaa548081b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.368483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b9c69-f8d2-4c91-b2cd-f904c5960738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.368583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a4d21-2797-4d42-a7ec-36aaa548081b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.368670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b9c69-f8d2-4c91-b2cd-f904c5960738 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.375766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 929/1875] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:47.376731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a4d21-2797-4d42-a7ec-36aaa548081b service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.389671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a4d21-2797-4d42-a7ec-36aaa548081b service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.395911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c9047-af9a-4f3a-9009-2f521da209ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.395911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c9047-af9a-4f3a-9009-2f521da209ee admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.395911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c9047-af9a-4f3a-9009-2f521da209ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.395911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c9047-af9a-4f3a-9009-2f521da209ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.396610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c9047-af9a-4f3a-9009-2f521da209ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.398437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c9047-af9a-4f3a-9009-2f521da209ee admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.417796 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 930/1876] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:47.417796 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c9047-af9a-4f3a-9009-2f521da209ee admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.431937 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c9047-af9a-4f3a-9009-2f521da209ee admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.438036 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9d332-f951-4789-aecd-75bc3090d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.439988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d332-f951-4789-aecd-75bc3090d516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.439988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d332-f951-4789-aecd-75bc3090d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.440299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d332-f951-4789-aecd-75bc3090d516 admin admin] PATH_INFO: `/v3/projects/a749904d035e4a6682f625054ad711f2/users/0eaa2fdbf9134c9cacf2c4254d0e9edc/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.457847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9d332-f951-4789-aecd-75bc3090d516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a749904d035e4a6682f625054ad711f2, user_id=0eaa2fdbf9134c9cacf2c4254d0e9edc, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.461529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9d332-f951-4789-aecd-75bc3090d516 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.502688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 947/1877] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:47 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:47.503913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b9c69-f8d2-4c91-b2cd-f904c5960738 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.519268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b9c69-f8d2-4c91-b2cd-f904c5960738 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.526666 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664ff14-75ab-4e1f-bde9-3455f2c0261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.527360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ff14-75ab-4e1f-bde9-3455f2c0261d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.529073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ff14-75ab-4e1f-bde9-3455f2c0261d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.529424 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ff14-75ab-4e1f-bde9-3455f2c0261d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.530310 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664ff14-75ab-4e1f-bde9-3455f2c0261d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.532201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664ff14-75ab-4e1f-bde9-3455f2c0261d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.560641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 948/1878] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:47.562380 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664ff14-75ab-4e1f-bde9-3455f2c0261d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.575831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 931/1879] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:47 2022] PUT /identity/v3/projects/a749904d035e4a6682f625054ad711f2/users/0eaa2fdbf9134c9cacf2c4254d0e9edc/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:47.577619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664ff14-75ab-4e1f-bde9-3455f2c0261d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.580526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9d332-f951-4789-aecd-75bc3090d516 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.655134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184df851-976b-4c6a-82d2-e054b3fb2e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.655964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184df851-976b-4c6a-82d2-e054b3fb2e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.656251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184df851-976b-4c6a-82d2-e054b3fb2e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.656692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184df851-976b-4c6a-82d2-e054b3fb2e42 admin admin] PATH_INFO: `/v3/projects/8befbc338f184c2692be18f7ee9b9be0/users/fe7abc76d83f4a23a183213668505053/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.684939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9d332-f951-4789-aecd-75bc3090d516 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.694340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184df851-976b-4c6a-82d2-e054b3fb2e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8befbc338f184c2692be18f7ee9b9be0, user_id=fe7abc76d83f4a23a183213668505053, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.698125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184df851-976b-4c6a-82d2-e054b3fb2e42 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.698510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765605d-9e07-4649-858b-6fb88e7fac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.700160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765605d-9e07-4649-858b-6fb88e7fac9a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.700697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765605d-9e07-4649-858b-6fb88e7fac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.702057 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765605d-9e07-4649-858b-6fb88e7fac9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.703231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765605d-9e07-4649-858b-6fb88e7fac9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.705065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765605d-9e07-4649-858b-6fb88e7fac9a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.717175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 932/1880] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:47.721198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765605d-9e07-4649-858b-6fb88e7fac9a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.731699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765605d-9e07-4649-858b-6fb88e7fac9a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.738806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31037d-2f55-408d-9373-f5bcd4110c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.739177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31037d-2f55-408d-9373-f5bcd4110c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.739463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31037d-2f55-408d-9373-f5bcd4110c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.739740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31037d-2f55-408d-9373-f5bcd4110c7b admin admin] PATH_INFO: `/v3/projects/a749904d035e4a6682f625054ad711f2/users/0eaa2fdbf9134c9cacf2c4254d0e9edc/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.742338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31037d-2f55-408d-9373-f5bcd4110c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a749904d035e4a6682f625054ad711f2, user_id=0eaa2fdbf9134c9cacf2c4254d0e9edc, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.745823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31037d-2f55-408d-9373-f5bcd4110c7b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.758139 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 933/1881] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:47 2022] PUT /identity/v3/projects/a749904d035e4a6682f625054ad711f2/users/0eaa2fdbf9134c9cacf2c4254d0e9edc/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:47.773998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db0a35-f8d9-41a3-a13e-150577935290 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.774956 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db0a35-f8d9-41a3-a13e-150577935290 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.774956 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db0a35-f8d9-41a3-a13e-150577935290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.788017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 949/1882] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:47 2022] PUT /identity/v3/projects/8befbc338f184c2692be18f7ee9b9be0/users/fe7abc76d83f4a23a183213668505053/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:47.794575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184df851-976b-4c6a-82d2-e054b3fb2e42 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.844958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-86db0a35-f8d9-41a3-a13e-150577935290 None None] MFA Rules not processed for user `0eaa2fdbf9134c9cacf2c4254d0e9edc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:47.846363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-86db0a35-f8d9-41a3-a13e-150577935290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:47.915787 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184df851-976b-4c6a-82d2-e054b3fb2e42 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.920822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49535e-f18c-4ef4-aced-715a669e65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.921529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49535e-f18c-4ef4-aced-715a669e65bb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.921738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49535e-f18c-4ef4-aced-715a669e65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.922016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49535e-f18c-4ef4-aced-715a669e65bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.924151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49535e-f18c-4ef4-aced-715a669e65bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.925940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49535e-f18c-4ef4-aced-715a669e65bb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.938705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 950/1883] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:47.943008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49535e-f18c-4ef4-aced-715a669e65bb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:47.956377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49535e-f18c-4ef4-aced-715a669e65bb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:47.963284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1203c4-6048-45c9-b4d5-760a540216c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:47.964075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1203c4-6048-45c9-b4d5-760a540216c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:47.964369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1203c4-6048-45c9-b4d5-760a540216c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:47.964664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1203c4-6048-45c9-b4d5-760a540216c8 admin admin] PATH_INFO: `/v3/projects/8befbc338f184c2692be18f7ee9b9be0/users/fe7abc76d83f4a23a183213668505053/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:47.967976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1203c4-6048-45c9-b4d5-760a540216c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8befbc338f184c2692be18f7ee9b9be0, user_id=fe7abc76d83f4a23a183213668505053, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:47.972955 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1203c4-6048-45c9-b4d5-760a540216c8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:47.985186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 934/1884] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:47.988638 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 951/1885] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:47 2022] PUT /identity/v3/projects/8befbc338f184c2692be18f7ee9b9be0/users/fe7abc76d83f4a23a183213668505053/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:47.999467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a15b4e-92af-4ca1-b663-524105ca35e1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:48.005961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a15b4e-92af-4ca1-b663-524105ca35e1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:48.005961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a15b4e-92af-4ca1-b663-524105ca35e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:48.028274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-03a15b4e-92af-4ca1-b663-524105ca35e1 None None] MFA Rules not processed for user `fe7abc76d83f4a23a183213668505053`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:48.029595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-03a15b4e-92af-4ca1-b663-524105ca35e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:48.067195 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1203c4-6048-45c9-b4d5-760a540216c8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:48.113282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 935/1886] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:48.132660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1203c4-6048-45c9-b4d5-760a540216c8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:48.137048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4e4f2-1d6d-40c2-90b0-9de1de4698f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:48.137747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4e4f2-1d6d-40c2-90b0-9de1de4698f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:48.138138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4e4f2-1d6d-40c2-90b0-9de1de4698f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:48.138413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4e4f2-1d6d-40c2-90b0-9de1de4698f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:48.183127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:48.218175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a15b4e-92af-4ca1-b663-524105ca35e1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:48.227988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a15b4e-92af-4ca1-b663-524105ca35e1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:48.230905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4e4f2-1d6d-40c2-90b0-9de1de4698f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:48.231952 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab6380-ad2f-4c17-a50b-52a46697d0f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:48.232543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4e4f2-1d6d-40c2-90b0-9de1de4698f3 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:48.232644 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab6380-ad2f-4c17-a50b-52a46697d0f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:48.232844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab6380-ad2f-4c17-a50b-52a46697d0f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:48.233164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab6380-ad2f-4c17-a50b-52a46697d0f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:48.242770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab6380-ad2f-4c17-a50b-52a46697d0f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:48.243169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 952/1887] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:48.244460 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab6380-ad2f-4c17-a50b-52a46697d0f0 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:48.254993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 936/1888] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:48.292639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4e4f2-1d6d-40c2-90b0-9de1de4698f3 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:48.298791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=8,keystone:SELECT=92 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:48.420594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4e4f2-1d6d-40c2-90b0-9de1de4698f3 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:48.426702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:48.427674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:48.428031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:48.428383 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] PATH_INFO: `/v3/users/afadb3c08dca442081738259116eac8a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:48.429715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=afadb3c08dca442081738259116eac8a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:48.432492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:48.440066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab6380-ad2f-4c17-a50b-52a46697d0f0 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:48.450232 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab6380-ad2f-4c17-a50b-52a46697d0f0 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:48.460091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50effab1-0e33-498c-8e16-423b910c0805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:48.461215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50effab1-0e33-498c-8e16-423b910c0805 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:48.462385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50effab1-0e33-498c-8e16-423b910c0805 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:48.463295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50effab1-0e33-498c-8e16-423b910c0805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:48.563970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50effab1-0e33-498c-8e16-423b910c0805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:48.565500 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50effab1-0e33-498c-8e16-423b910c0805 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:48.575822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 937/1889] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:48.638464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afadb3c08dca442081738259116eac8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:48.639425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afadb3c08dca442081738259116eac8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:48.761715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afadb3c08dca442081738259116eac8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:48.762304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afadb3c08dca442081738259116eac8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:48.779615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afadb3c08dca442081738259116eac8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:48.801361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 953/1890] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:48 2022] DELETE /identity/v3/users/afadb3c08dca442081738259116eac8a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:48.803452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bc475-0bc4-4b4a-b0c1-215f037825d1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:48.804437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bc475-0bc4-4b4a-b0c1-215f037825d1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:48.804914 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bc475-0bc4-4b4a-b0c1-215f037825d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:48.828383 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cf0bc475-0bc4-4b4a-b0c1-215f037825d1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:48.829703 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cf0bc475-0bc4-4b4a-b0c1-215f037825d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:48.931825 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 938/1891] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:48.938214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:48.939699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:49.045860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582dbbb-5152-4684-8a5b-df3f68c3fa1c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:49.050246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecee690-09d0-49cf-8183-ff716bf74f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:49.054039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecee690-09d0-49cf-8183-ff716bf74f6b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:49.054039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecee690-09d0-49cf-8183-ff716bf74f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:49.054039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecee690-09d0-49cf-8183-ff716bf74f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:49.063623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecee690-09d0-49cf-8183-ff716bf74f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:49.065089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecee690-09d0-49cf-8183-ff716bf74f6b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:49.076357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 954/1892] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:49.311428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bc475-0bc4-4b4a-b0c1-215f037825d1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:49.312866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cf0bc475-0bc4-4b4a-b0c1-215f037825d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:49.325297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bc475-0bc4-4b4a-b0c1-215f037825d1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:49.330015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f413204-2003-4a95-94f8-a47dea3d78fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:49.330668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f413204-2003-4a95-94f8-a47dea3d78fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:49.330948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f413204-2003-4a95-94f8-a47dea3d78fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:49.331224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f413204-2003-4a95-94f8-a47dea3d78fc admin admin] PATH_INFO: `/v3/users/afd95377175d423f97d8f79f5d4887e9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:49.332521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f413204-2003-4a95-94f8-a47dea3d78fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd95377175d423f97d8f79f5d4887e9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:49.334552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f413204-2003-4a95-94f8-a47dea3d78fc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:49.604714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecee690-09d0-49cf-8183-ff716bf74f6b service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:49.607505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3ecee690-09d0-49cf-8183-ff716bf74f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:49.625427 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1f413204-2003-4a95-94f8-a47dea3d78fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd95377175d423f97d8f79f5d4887e9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:49.626422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecee690-09d0-49cf-8183-ff716bf74f6b service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:49.656876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:49.657745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:49.658290 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:49.658763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] PATH_INFO: `/v3/projects/8f638e9ba1ad406dbff0bc2ea78b5488` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:49.660767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f638e9ba1ad406dbff0bc2ea78b5488)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:49.664189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:49.670705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:49.699141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1f413204-2003-4a95-94f8-a47dea3d78fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd95377175d423f97d8f79f5d4887e9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:49.699812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1f413204-2003-4a95-94f8-a47dea3d78fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd95377175d423f97d8f79f5d4887e9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:49.700617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1f413204-2003-4a95-94f8-a47dea3d78fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd95377175d423f97d8f79f5d4887e9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:49.719308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1f413204-2003-4a95-94f8-a47dea3d78fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd95377175d423f97d8f79f5d4887e9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:49.745158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 939/1893] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:49 2022] DELETE /identity/v3/users/afd95377175d423f97d8f79f5d4887e9 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:49.749103 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557fdc-3fd3-4031-8dde-abd1e96bbecd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:49.749392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557fdc-3fd3-4031-8dde-abd1e96bbecd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:49.749717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557fdc-3fd3-4031-8dde-abd1e96bbecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:49.772367 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5c557fdc-3fd3-4031-8dde-abd1e96bbecd None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:49.774134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5c557fdc-3fd3-4031-8dde-abd1e96bbecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:49.843184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 940/1894] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:49.859721 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557fdc-3fd3-4031-8dde-abd1e96bbecd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:49.862853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5c557fdc-3fd3-4031-8dde-abd1e96bbecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:49.873173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f638e9ba1ad406dbff0bc2ea78b5488', 'request_id': 'req-767d2879-38d2-4d9f-8803-2b5936d57953'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:49.882794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f638e9ba1ad406dbff0bc2ea78b5488', 'request_id': 'req-767d2879-38d2-4d9f-8803-2b5936d57953'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:49.891639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f638e9ba1ad406dbff0bc2ea78b5488', 'request_id': 'req-767d2879-38d2-4d9f-8803-2b5936d57953'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:49.988355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] The token cache is being invalidate because project 8f638e9ba1ad406dbff0bc2ea78b5488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:49.988841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:49.989716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:49.996915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 955/1895] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:49 2022] DELETE /identity/v3/projects/8f638e9ba1ad406dbff0bc2ea78b5488 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:49.996915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:49.997150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557fdc-3fd3-4031-8dde-abd1e96bbecd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:50.002233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:50.060146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aca519-5486-4e02-b948-76935d12657a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:50.060937 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aca519-5486-4e02-b948-76935d12657a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:50.061370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aca519-5486-4e02-b948-76935d12657a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:50.061766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aca519-5486-4e02-b948-76935d12657a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:50.063630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a3aca519-5486-4e02-b948-76935d12657a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:50.087145 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d2879-38d2-4d9f-8803-2b5936d57953 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:50.106494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ce0c9-50fd-475c-8e15-6776522c54a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:50.108920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ce0c9-50fd-475c-8e15-6776522c54a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:50.109284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ce0c9-50fd-475c-8e15-6776522c54a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:50.109562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ce0c9-50fd-475c-8e15-6776522c54a6 admin admin] PATH_INFO: `/v3/users/fe7abc76d83f4a23a183213668505053` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:50.110930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ce0c9-50fd-475c-8e15-6776522c54a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7abc76d83f4a23a183213668505053)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:50.112870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ce0c9-50fd-475c-8e15-6776522c54a6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:50.166656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aca519-5486-4e02-b948-76935d12657a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:50.168195 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aca519-5486-4e02-b948-76935d12657a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:50.180228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 941/1896] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:50.213217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:50.357053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8d3ce0c9-50fd-475c-8e15-6776522c54a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7abc76d83f4a23a183213668505053'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:50.357754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8d3ce0c9-50fd-475c-8e15-6776522c54a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7abc76d83f4a23a183213668505053'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:50.451523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8d3ce0c9-50fd-475c-8e15-6776522c54a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7abc76d83f4a23a183213668505053'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:50.452654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8d3ce0c9-50fd-475c-8e15-6776522c54a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7abc76d83f4a23a183213668505053'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:50.469780 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8d3ce0c9-50fd-475c-8e15-6776522c54a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7abc76d83f4a23a183213668505053'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:50.488159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 956/1897] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:49 2022] DELETE /identity/v3/users/fe7abc76d83f4a23a183213668505053 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:50.777166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aca519-5486-4e02-b948-76935d12657a service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:50.779148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a3aca519-5486-4e02-b948-76935d12657a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:50.841571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aca519-5486-4e02-b948-76935d12657a service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:50.935644 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:50.942255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:50.942255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:50.942255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] PATH_INFO: `/v3/projects/adfb2b40b97c47548db83e4378c92ac6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:50.942255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfb2b40b97c47548db83e4378c92ac6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:50.942255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:51.099215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfb2b40b97c47548db83e4378c92ac6', 'request_id': 'req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.107861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfb2b40b97c47548db83e4378c92ac6', 'request_id': 'req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.114854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfb2b40b97c47548db83e4378c92ac6', 'request_id': 'req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.154458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b050-76a8-4e90-b4fe-df13353b8ad5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:51.155373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b050-76a8-4e90-b4fe-df13353b8ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:51.155716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b050-76a8-4e90-b4fe-df13353b8ad5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:51.157220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 957/1898] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 05:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:38:51.168408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d9e7d-ab9e-4f9b-969b-d84ee997de35 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:51.169628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d9e7d-ab9e-4f9b-969b-d84ee997de35 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:51.170094 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d9e7d-ab9e-4f9b-969b-d84ee997de35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:51.199843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-535d9e7d-ab9e-4f9b-969b-d84ee997de35 None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:51.208647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] The token cache is being invalidate because project adfb2b40b97c47548db83e4378c92ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:51.212227 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.213281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.217721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-535d9e7d-ab9e-4f9b-969b-d84ee997de35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:51.218076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 942/1899] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:50 2022] DELETE /identity/v3/projects/adfb2b40b97c47548db83e4378c92ac6 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:51.219143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:51.220667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:51.297868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 958/1900] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 05:38:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:51.298953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d9e7d-ab9e-4f9b-969b-d84ee997de35 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:51.302097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-535d9e7d-ab9e-4f9b-969b-d84ee997de35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:51.319056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaddf1b-d16c-445d-aeb0-5d282ad0b723 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:51.324570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:51.326309 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:51.326599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:51.326869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] PATH_INFO: `/v3/projects/8befbc338f184c2692be18f7ee9b9be0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:51.328272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8befbc338f184c2692be18f7ee9b9be0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:51.330619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:51.399957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d9e7d-ab9e-4f9b-969b-d84ee997de35 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:51.405192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83615390-95d0-47b6-ad8a-0528188493f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:51.406060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615390-95d0-47b6-ad8a-0528188493f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:51.406353 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615390-95d0-47b6-ad8a-0528188493f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:51.406864 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615390-95d0-47b6-ad8a-0528188493f8 admin admin] PATH_INFO: `/v3/users/0eaa2fdbf9134c9cacf2c4254d0e9edc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:51.415735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83615390-95d0-47b6-ad8a-0528188493f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eaa2fdbf9134c9cacf2c4254d0e9edc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:51.418491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83615390-95d0-47b6-ad8a-0528188493f8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:51.500862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8befbc338f184c2692be18f7ee9b9be0', 'request_id': 'req-0c4b3b12-aac8-4424-a653-5ee8b67606f4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.509157 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8befbc338f184c2692be18f7ee9b9be0', 'request_id': 'req-0c4b3b12-aac8-4424-a653-5ee8b67606f4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.518495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8befbc338f184c2692be18f7ee9b9be0', 'request_id': 'req-0c4b3b12-aac8-4424-a653-5ee8b67606f4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.590200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:51.632286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-83615390-95d0-47b6-ad8a-0528188493f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaa2fdbf9134c9cacf2c4254d0e9edc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.633910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-83615390-95d0-47b6-ad8a-0528188493f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaa2fdbf9134c9cacf2c4254d0e9edc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.640645 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] The token cache is being invalidate because project 8befbc338f184c2692be18f7ee9b9be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:51.641107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.641911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.650421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 943/1901] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:51 2022] DELETE /identity/v3/projects/8befbc338f184c2692be18f7ee9b9be0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:51.650421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:51.650421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:51.716215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-83615390-95d0-47b6-ad8a-0528188493f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaa2fdbf9134c9cacf2c4254d0e9edc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.717078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-83615390-95d0-47b6-ad8a-0528188493f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaa2fdbf9134c9cacf2c4254d0e9edc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.731476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-83615390-95d0-47b6-ad8a-0528188493f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaa2fdbf9134c9cacf2c4254d0e9edc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:51.748156 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 959/1902] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:51 2022] DELETE /identity/v3/users/0eaa2fdbf9134c9cacf2c4254d0e9edc => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:51.754124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2300-be85-442c-8b0c-a1fad19bce05 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:51.754435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2300-be85-442c-8b0c-a1fad19bce05 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:51.754715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc2300-be85-442c-8b0c-a1fad19bce05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:51.783544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b3b12-aac8-4424-a653-5ee8b67606f4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:51.783768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d4fc2300-be85-442c-8b0c-a1fad19bce05 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:51.784995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d4fc2300-be85-442c-8b0c-a1fad19bce05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:51.896359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e9acf-925b-42c2-a821-4b3a7e33666e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:51.898031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e9acf-925b-42c2-a821-4b3a7e33666e service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:51.898319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e9acf-925b-42c2-a821-4b3a7e33666e service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:51.898659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e9acf-925b-42c2-a821-4b3a7e33666e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:51.903476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-465e9acf-925b-42c2-a821-4b3a7e33666e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:51.914191 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 960/1903] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:51.924185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e9acf-925b-42c2-a821-4b3a7e33666e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:51.924597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba175c95-b8f7-4c0e-9398-d797b9a5d986 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:51.924845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba175c95-b8f7-4c0e-9398-d797b9a5d986 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:51.925116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba175c95-b8f7-4c0e-9398-d797b9a5d986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:51.930401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e9acf-925b-42c2-a821-4b3a7e33666e service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:51.940846 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 944/1904] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:51.949090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ba175c95-b8f7-4c0e-9398-d797b9a5d986 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:51.950416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba175c95-b8f7-4c0e-9398-d797b9a5d986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:51.961185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 961/1905] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:51.965341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e9acf-925b-42c2-a821-4b3a7e33666e service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:51.980613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e9acf-925b-42c2-a821-4b3a7e33666e service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:51.988400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e236710-6d27-44e3-8c86-c50d84c343a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:51.988400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e236710-6d27-44e3-8c86-c50d84c343a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:51.988400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e236710-6d27-44e3-8c86-c50d84c343a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:51.988400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e236710-6d27-44e3-8c86-c50d84c343a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:51.990029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e236710-6d27-44e3-8c86-c50d84c343a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:51.990029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e236710-6d27-44e3-8c86-c50d84c343a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:51.991209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e236710-6d27-44e3-8c86-c50d84c343a4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:52.009082 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 945/1906] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:52.020333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba175c95-b8f7-4c0e-9398-d797b9a5d986 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:52.032307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba175c95-b8f7-4c0e-9398-d797b9a5d986 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:52.038777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684de1-af2b-4ec2-8fde-d15acc011454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:52.040315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684de1-af2b-4ec2-8fde-d15acc011454 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:52.040696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684de1-af2b-4ec2-8fde-d15acc011454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:52.041180 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684de1-af2b-4ec2-8fde-d15acc011454 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:52.042382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6684de1-af2b-4ec2-8fde-d15acc011454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:52.045154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6684de1-af2b-4ec2-8fde-d15acc011454 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:52.202194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:52.221833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e236710-6d27-44e3-8c86-c50d84c343a4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:52.234250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 962/1907] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:52 2022] POST /identity/v3/projects => generated 371 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:52.238218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e236710-6d27-44e3-8c86-c50d84c343a4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:52.303154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696822c-3c1b-46e8-9d81-0f3fb83c43b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:52.303788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696822c-3c1b-46e8-9d81-0f3fb83c43b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:52.304068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696822c-3c1b-46e8-9d81-0f3fb83c43b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:52.304339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696822c-3c1b-46e8-9d81-0f3fb83c43b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:52.305047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696822c-3c1b-46e8-9d81-0f3fb83c43b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:52.308603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696822c-3c1b-46e8-9d81-0f3fb83c43b5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:52.463923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684de1-af2b-4ec2-8fde-d15acc011454 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:52.468106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b6684de1-af2b-4ec2-8fde-d15acc011454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:52.476927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 946/1908] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:52 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:52.485106 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696822c-3c1b-46e8-9d81-0f3fb83c43b5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:52.502943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684de1-af2b-4ec2-8fde-d15acc011454 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:52.507278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696822c-3c1b-46e8-9d81-0f3fb83c43b5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:52.514401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea825a0f-758a-48cb-a6f6-17d157c1f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:52.515027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea825a0f-758a-48cb-a6f6-17d157c1f2bb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:52.515317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea825a0f-758a-48cb-a6f6-17d157c1f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:52.515600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea825a0f-758a-48cb-a6f6-17d157c1f2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:52.516306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea825a0f-758a-48cb-a6f6-17d157c1f2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:52.520576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:52.521378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:52.521521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:52.521977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] PATH_INFO: `/v3/projects/a749904d035e4a6682f625054ad711f2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:52.528141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a749904d035e4a6682f625054ad711f2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:52.528141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:52.528307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea825a0f-758a-48cb-a6f6-17d157c1f2bb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:52.548175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 947/1909] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:52.549324 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea825a0f-758a-48cb-a6f6-17d157c1f2bb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:52.562624 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea825a0f-758a-48cb-a6f6-17d157c1f2bb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:52.567941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e519-86ac-4ff0-a0e9-215e90955568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:52.568602 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e519-86ac-4ff0-a0e9-215e90955568 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:52.568881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e519-86ac-4ff0-a0e9-215e90955568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:52.569224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e519-86ac-4ff0-a0e9-215e90955568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:52.569879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1e519-86ac-4ff0-a0e9-215e90955568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:52.572203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1e519-86ac-4ff0-a0e9-215e90955568 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:52.585177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 948/1910] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:38:52.589013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e519-86ac-4ff0-a0e9-215e90955568 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:52.599226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e519-86ac-4ff0-a0e9-215e90955568 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:52.605863 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb791e3c-e8a6-4f55-aa09-06a27c71515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:52.606552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791e3c-e8a6-4f55-aa09-06a27c71515c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:52.606834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791e3c-e8a6-4f55-aa09-06a27c71515c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:52.607113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791e3c-e8a6-4f55-aa09-06a27c71515c admin admin] PATH_INFO: `/v3/projects/228540c351cf4edb91c453ac4d4662ce/users/d1647df42a1c42fbb0592b54ec8d0d67/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:52.624574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791e3c-e8a6-4f55-aa09-06a27c71515c admin admin] RBAC: Authorizing `identity:create_grant(project_id=228540c351cf4edb91c453ac4d4662ce, user_id=d1647df42a1c42fbb0592b54ec8d0d67, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:52.635236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791e3c-e8a6-4f55-aa09-06a27c71515c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:52.720373 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 949/1911] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:52 2022] PUT /identity/v3/projects/228540c351cf4edb91c453ac4d4662ce/users/d1647df42a1c42fbb0592b54ec8d0d67/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:52.733826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a749904d035e4a6682f625054ad711f2', 'request_id': 'req-7421b974-7558-45a9-88e5-bf2c1c99c5e7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:52.734867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72ec3-149c-4b75-ae7e-b7bdfc7a0998 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:52.736702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72ec3-149c-4b75-ae7e-b7bdfc7a0998 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:52.738741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72ec3-149c-4b75-ae7e-b7bdfc7a0998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:52.752724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a749904d035e4a6682f625054ad711f2', 'request_id': 'req-7421b974-7558-45a9-88e5-bf2c1c99c5e7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:52.760918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a749904d035e4a6682f625054ad711f2', 'request_id': 'req-7421b974-7558-45a9-88e5-bf2c1c99c5e7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:52.790992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-78a72ec3-149c-4b75-ae7e-b7bdfc7a0998 None None] MFA Rules not processed for user `d1647df42a1c42fbb0592b54ec8d0d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:52.792226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-78a72ec3-149c-4b75-ae7e-b7bdfc7a0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:52.895798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 950/1912] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:52.909766 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] The token cache is being invalidate because project a749904d035e4a6682f625054ad711f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:52.909766 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:52.909766 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7421b974-7558-45a9-88e5-bf2c1c99c5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:52.917226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 963/1913] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:52 2022] DELETE /identity/v3/projects/a749904d035e4a6682f625054ad711f2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:52.917598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a72ec3-149c-4b75-ae7e-b7bdfc7a0998 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:52.918776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-78a72ec3-149c-4b75-ae7e-b7bdfc7a0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:52.921560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8bdd-6067-4fe4-a570-01f012005747 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:52.922514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8bdd-6067-4fe4-a570-01f012005747 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:52.922973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8bdd-6067-4fe4-a570-01f012005747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:52.955694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1c5d8bdd-6067-4fe4-a570-01f012005747 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:52.957529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1c5d8bdd-6067-4fe4-a570-01f012005747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:52.993915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a72ec3-149c-4b75-ae7e-b7bdfc7a0998 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:53.001636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47346def-0aeb-40bb-9b7b-cfe81dc7b3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:53.005488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47346def-0aeb-40bb-9b7b-cfe81dc7b3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.005488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47346def-0aeb-40bb-9b7b-cfe81dc7b3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.005488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47346def-0aeb-40bb-9b7b-cfe81dc7b3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.006346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-47346def-0aeb-40bb-9b7b-cfe81dc7b3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:53.023604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47346def-0aeb-40bb-9b7b-cfe81dc7b3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:53.027176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47346def-0aeb-40bb-9b7b-cfe81dc7b3b3 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:53.044410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 964/1914] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:53.046204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff58a6-d649-4331-b698-70d2b7b00c12 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.052607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff58a6-d649-4331-b698-70d2b7b00c12 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.052607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff58a6-d649-4331-b698-70d2b7b00c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.056167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 951/1915] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:53.077591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a1ff58a6-d649-4331-b698-70d2b7b00c12 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:53.081416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a1ff58a6-d649-4331-b698-70d2b7b00c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:53.083241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47346def-0aeb-40bb-9b7b-cfe81dc7b3b3 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:53.085416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-47346def-0aeb-40bb-9b7b-cfe81dc7b3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:53.105813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 965/1916] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:53.106824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47346def-0aeb-40bb-9b7b-cfe81dc7b3b3 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:53.108307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff58a6-d649-4331-b698-70d2b7b00c12 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:53.114552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:53.114692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.114912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.115166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] PATH_INFO: `/v3/users/d1647df42a1c42fbb0592b54ec8d0d67` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.116347 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1647df42a1c42fbb0592b54ec8d0d67)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:53.118843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff58a6-d649-4331-b698-70d2b7b00c12 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:53.118954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:53.124377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01345ef1-d92e-46e4-b569-5149137b0727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:53.124721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01345ef1-d92e-46e4-b569-5149137b0727 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.124995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01345ef1-d92e-46e4-b569-5149137b0727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.125333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01345ef1-d92e-46e4-b569-5149137b0727 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.126393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01345ef1-d92e-46e4-b569-5149137b0727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:53.126507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01345ef1-d92e-46e4-b569-5149137b0727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:53.128500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01345ef1-d92e-46e4-b569-5149137b0727 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:53.143594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 966/1917] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:53.148009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01345ef1-d92e-46e4-b569-5149137b0727 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:53.158806 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01345ef1-d92e-46e4-b569-5149137b0727 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:53.164186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaffdf-43d2-43c6-bc4a-aa39e798d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:53.165571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaffdf-43d2-43c6-bc4a-aa39e798d5fa admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.165877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaffdf-43d2-43c6-bc4a-aa39e798d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.166152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaffdf-43d2-43c6-bc4a-aa39e798d5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.170963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaffdf-43d2-43c6-bc4a-aa39e798d5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:53.170963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaffdf-43d2-43c6-bc4a-aa39e798d5fa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:53.286317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 967/1918] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:53 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:53.291655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaffdf-43d2-43c6-bc4a-aa39e798d5fa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:53.347906 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1647df42a1c42fbb0592b54ec8d0d67'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:53.358872 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaffdf-43d2-43c6-bc4a-aa39e798d5fa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:53.366243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb755ec7-6768-4ff0-b243-f8ee066d6dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:53.367085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755ec7-6768-4ff0-b243-f8ee066d6dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.367537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755ec7-6768-4ff0-b243-f8ee066d6dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.368406 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755ec7-6768-4ff0-b243-f8ee066d6dcd admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.369625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb755ec7-6768-4ff0-b243-f8ee066d6dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:53.371048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb755ec7-6768-4ff0-b243-f8ee066d6dcd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:53.418425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1647df42a1c42fbb0592b54ec8d0d67'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:53.419150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1647df42a1c42fbb0592b54ec8d0d67'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:53.419884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1647df42a1c42fbb0592b54ec8d0d67'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:53.437659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1647df42a1c42fbb0592b54ec8d0d67'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:53.450917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 968/1919] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:53 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:53.452020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb755ec7-6768-4ff0-b243-f8ee066d6dcd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:53.454528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fb755ec7-6768-4ff0-b243-f8ee066d6dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:53.461613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 952/1920] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:53 2022] DELETE /identity/v3/users/d1647df42a1c42fbb0592b54ec8d0d67 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:53.462854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:53.466766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:53.471087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb755ec7-6768-4ff0-b243-f8ee066d6dcd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:53.553934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1f41f-d091-4ba3-9aad-32a7a51fce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:53.554788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1f41f-d091-4ba3-9aad-32a7a51fce99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.555871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1f41f-d091-4ba3-9aad-32a7a51fce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.556272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1f41f-d091-4ba3-9aad-32a7a51fce99 admin admin] PATH_INFO: `/v3/users/bc9c0772e5ca4709a99701dab765a9c3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.557547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1f41f-d091-4ba3-9aad-32a7a51fce99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9c0772e5ca4709a99701dab765a9c3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:53.559651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1f41f-d091-4ba3-9aad-32a7a51fce99 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:53.559881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54e4f2-9212-4021-828f-3f68e08c99b8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:53.566084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a7132-41c1-4c35-8498-5b0b38d1d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:53.566695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a7132-41c1-4c35-8498-5b0b38d1d49a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.566897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a7132-41c1-4c35-8498-5b0b38d1d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.567170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a7132-41c1-4c35-8498-5b0b38d1d49a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.567875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a7132-41c1-4c35-8498-5b0b38d1d49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:53.569656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a7132-41c1-4c35-8498-5b0b38d1d49a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:53.583379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 953/1921] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:53.583379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958f101-dddd-4286-9ac3-61764cdb33e8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.583379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958f101-dddd-4286-9ac3-61764cdb33e8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.583379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958f101-dddd-4286-9ac3-61764cdb33e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.601442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e958f101-dddd-4286-9ac3-61764cdb33e8 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:53.603323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e958f101-dddd-4286-9ac3-61764cdb33e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:53.610833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 954/1922] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:53.611623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958f101-dddd-4286-9ac3-61764cdb33e8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:53.624361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958f101-dddd-4286-9ac3-61764cdb33e8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:53.629330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da376a70-55f0-4dca-8b2e-966470d2f201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:53.629949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da376a70-55f0-4dca-8b2e-966470d2f201 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.630227 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da376a70-55f0-4dca-8b2e-966470d2f201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.630502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da376a70-55f0-4dca-8b2e-966470d2f201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.631200 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da376a70-55f0-4dca-8b2e-966470d2f201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:53.633049 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da376a70-55f0-4dca-8b2e-966470d2f201 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:53.643643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 955/1923] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:53.644499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da376a70-55f0-4dca-8b2e-966470d2f201 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:53.646260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-da376a70-55f0-4dca-8b2e-966470d2f201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:53.704037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da376a70-55f0-4dca-8b2e-966470d2f201 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:53.707673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833a686-4ddc-4194-af60-3c9113a1d854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:53.708313 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833a686-4ddc-4194-af60-3c9113a1d854 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.708589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833a686-4ddc-4194-af60-3c9113a1d854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.708869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833a686-4ddc-4194-af60-3c9113a1d854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.718933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833a686-4ddc-4194-af60-3c9113a1d854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:53.720373 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833a686-4ddc-4194-af60-3c9113a1d854 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:53.729911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 956/1924] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:53.730669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833a686-4ddc-4194-af60-3c9113a1d854 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:53.739695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833a686-4ddc-4194-af60-3c9113a1d854 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:53.745794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d31a5-48aa-4b0a-9320-eb5c81ba3431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:53.746464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d31a5-48aa-4b0a-9320-eb5c81ba3431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.749282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d31a5-48aa-4b0a-9320-eb5c81ba3431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.749282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d31a5-48aa-4b0a-9320-eb5c81ba3431 admin admin] PATH_INFO: `/v3/projects/c9b002fbe4b34769b19754f3902e7069/users/9dd82d62ae3b4d0b8d803b556a6d0158/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.753454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b0f1f41f-d091-4ba3-9aad-32a7a51fce99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9c0772e5ca4709a99701dab765a9c3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:53.754165 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b0f1f41f-d091-4ba3-9aad-32a7a51fce99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9c0772e5ca4709a99701dab765a9c3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:53.762356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d31a5-48aa-4b0a-9320-eb5c81ba3431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b002fbe4b34769b19754f3902e7069, user_id=9dd82d62ae3b4d0b8d803b556a6d0158, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:53.765010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d31a5-48aa-4b0a-9320-eb5c81ba3431 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:53.824084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b0f1f41f-d091-4ba3-9aad-32a7a51fce99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9c0772e5ca4709a99701dab765a9c3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:53.825072 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b0f1f41f-d091-4ba3-9aad-32a7a51fce99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9c0772e5ca4709a99701dab765a9c3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:53.838518 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b0f1f41f-d091-4ba3-9aad-32a7a51fce99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9c0772e5ca4709a99701dab765a9c3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:53.851361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 969/1925] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:53 2022] DELETE /identity/v3/users/bc9c0772e5ca4709a99701dab765a9c3 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:53.856327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45241-6b94-49c1-9404-37883dbba2c6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.856617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45241-6b94-49c1-9404-37883dbba2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.856891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45241-6b94-49c1-9404-37883dbba2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.876847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7fd45241-6b94-49c1-9404-37883dbba2c6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:53.878089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7fd45241-6b94-49c1-9404-37883dbba2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:53.888695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:53.900601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 957/1926] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:53 2022] PUT /identity/v3/projects/c9b002fbe4b34769b19754f3902e7069/users/9dd82d62ae3b4d0b8d803b556a6d0158/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:53.908909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e24118-f9b5-4d91-afdd-0130b5f8a37f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:53.909447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e24118-f9b5-4d91-afdd-0130b5f8a37f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:53.909895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e24118-f9b5-4d91-afdd-0130b5f8a37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:53.963476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:53.971622 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c7e24118-f9b5-4d91-afdd-0130b5f8a37f None None] MFA Rules not processed for user `9dd82d62ae3b4d0b8d803b556a6d0158`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:53.972921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c7e24118-f9b5-4d91-afdd-0130b5f8a37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:53.986060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 970/1927] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:54.001985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45241-6b94-49c1-9404-37883dbba2c6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:54.003942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7fd45241-6b94-49c1-9404-37883dbba2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:54.139154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 958/1928] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:54.170484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e24118-f9b5-4d91-afdd-0130b5f8a37f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:54.180116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c7e24118-f9b5-4d91-afdd-0130b5f8a37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:54.207198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45241-6b94-49c1-9404-37883dbba2c6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:54.261712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e24118-f9b5-4d91-afdd-0130b5f8a37f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:54.268175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c318682-5352-4139-94a1-f3352199805c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:54.269893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c318682-5352-4139-94a1-f3352199805c service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:54.270487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c318682-5352-4139-94a1-f3352199805c service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:54.270765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c318682-5352-4139-94a1-f3352199805c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:54.286792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7a4df-3765-4f21-adf0-6e0253d16aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:54.286792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a4df-3765-4f21-adf0-6e0253d16aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:54.286792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a4df-3765-4f21-adf0-6e0253d16aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:54.286792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a4df-3765-4f21-adf0-6e0253d16aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:54.287630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c318682-5352-4139-94a1-f3352199805c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:54.288560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c318682-5352-4139-94a1-f3352199805c service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:54.322714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 959/1929] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:54.402087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7a4df-3765-4f21-adf0-6e0253d16aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:54.404546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7a4df-3765-4f21-adf0-6e0253d16aa3 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:54.429951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 971/1930] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:54.550562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c318682-5352-4139-94a1-f3352199805c service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:54.552115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1c318682-5352-4139-94a1-f3352199805c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:54.568410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c318682-5352-4139-94a1-f3352199805c service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:54.574803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:54.575464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:54.575949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:54.576216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] PATH_INFO: `/v3/projects/228540c351cf4edb91c453ac4d4662ce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:54.577625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=228540c351cf4edb91c453ac4d4662ce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:54.579568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:54.713476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228540c351cf4edb91c453ac4d4662ce', 'request_id': 'req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:54.738364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228540c351cf4edb91c453ac4d4662ce', 'request_id': 'req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:54.763551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228540c351cf4edb91c453ac4d4662ce', 'request_id': 'req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:54.841083 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] The token cache is being invalidate because project 228540c351cf4edb91c453ac4d4662ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:54.841396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:54.842023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cf5ad21-87a8-44e3-ac62-ee8420db8ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:54.843749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 960/1931] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:54 2022] DELETE /identity/v3/projects/228540c351cf4edb91c453ac4d4662ce => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:54.848465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123668f-fa93-4c7e-84c5-8b33e1bedb71 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:54.848753 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123668f-fa93-4c7e-84c5-8b33e1bedb71 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:54.849023 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123668f-fa93-4c7e-84c5-8b33e1bedb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:54.875951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2123668f-fa93-4c7e-84c5-8b33e1bedb71 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:54.877205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2123668f-fa93-4c7e-84c5-8b33e1bedb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:54.938813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 972/1932] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:54.946906 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fc79f-492e-422f-b37e-68d95b2b1b72 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:54.947211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fc79f-492e-422f-b37e-68d95b2b1b72 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:54.947465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fc79f-492e-422f-b37e-68d95b2b1b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:54.958638 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123668f-fa93-4c7e-84c5-8b33e1bedb71 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:54.966433 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2123668f-fa93-4c7e-84c5-8b33e1bedb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:54.983580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123668f-fa93-4c7e-84c5-8b33e1bedb71 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:54.988617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:54.989332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:54.989462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ff1fc79f-492e-422f-b37e-68d95b2b1b72 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:54.989659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:54.989887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] PATH_INFO: `/v3/projects/6fb355f861d3472b8a0bff142c3274f7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:54.990646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ff1fc79f-492e-422f-b37e-68d95b2b1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:54.991249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb355f861d3472b8a0bff142c3274f7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:54.994118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:55.002604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 961/1933] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:55.010431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fc79f-492e-422f-b37e-68d95b2b1b72 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:55.024149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fc79f-492e-422f-b37e-68d95b2b1b72 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:55.033067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9ea30-3230-4991-b01e-e5996056cbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:55.034158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9ea30-3230-4991-b01e-e5996056cbdb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.034451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9ea30-3230-4991-b01e-e5996056cbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.034711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9ea30-3230-4991-b01e-e5996056cbdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.036151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9ea30-3230-4991-b01e-e5996056cbdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:55.036581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9ea30-3230-4991-b01e-e5996056cbdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:55.038256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9ea30-3230-4991-b01e-e5996056cbdb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:55.052632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 962/1934] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:55.058084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9ea30-3230-4991-b01e-e5996056cbdb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:55.070618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9ea30-3230-4991-b01e-e5996056cbdb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:55.080076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cc5d2-3b76-4b44-8975-224377db80b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:55.081038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cc5d2-3b76-4b44-8975-224377db80b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.081393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cc5d2-3b76-4b44-8975-224377db80b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.081662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cc5d2-3b76-4b44-8975-224377db80b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.083198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cc5d2-3b76-4b44-8975-224377db80b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:55.085609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cc5d2-3b76-4b44-8975-224377db80b3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:55.182339 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb355f861d3472b8a0bff142c3274f7', 'request_id': 'req-cab9c29c-65ee-4c2d-9622-abef1c3ae963'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:55.203000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb355f861d3472b8a0bff142c3274f7', 'request_id': 'req-cab9c29c-65ee-4c2d-9622-abef1c3ae963'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:55.211097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb355f861d3472b8a0bff142c3274f7', 'request_id': 'req-cab9c29c-65ee-4c2d-9622-abef1c3ae963'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:55.227813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 963/1935] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:55 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:55.231662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cc5d2-3b76-4b44-8975-224377db80b3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:55.304280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:55.338648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] The token cache is being invalidate because project 6fb355f861d3472b8a0bff142c3274f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:55.338984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:55.339658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:55.342173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 973/1936] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:54 2022] DELETE /identity/v3/projects/6fb355f861d3472b8a0bff142c3274f7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:55.345554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cc5d2-3b76-4b44-8975-224377db80b3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:55.345910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:55.347947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:55.350529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62217771-da61-420a-b2c8-a2216e24ead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:55.351161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217771-da61-420a-b2c8-a2216e24ead6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.351474 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217771-da61-420a-b2c8-a2216e24ead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.351743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217771-da61-420a-b2c8-a2216e24ead6 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.353454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62217771-da61-420a-b2c8-a2216e24ead6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:55.355417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62217771-da61-420a-b2c8-a2216e24ead6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:55.425623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9c29c-65ee-4c2d-9622-abef1c3ae963 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:55.430757 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:55.431378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.431660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.431935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] PATH_INFO: `/v3/users/e1e71f89cd564e1a98523d5f9b1a4537` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.433103 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e71f89cd564e1a98523d5f9b1a4537)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:55.435108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:55.493283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 964/1937] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:55 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:55.497268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62217771-da61-420a-b2c8-a2216e24ead6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:55.499054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-62217771-da61-420a-b2c8-a2216e24ead6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:55.511869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62217771-da61-420a-b2c8-a2216e24ead6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:55.516678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7eb76d-4a9d-4fc2-a5ee-e5d9addbecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:55.517397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eb76d-4a9d-4fc2-a5ee-e5d9addbecc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.517745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eb76d-4a9d-4fc2-a5ee-e5d9addbecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.518080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eb76d-4a9d-4fc2-a5ee-e5d9addbecc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.518905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7eb76d-4a9d-4fc2-a5ee-e5d9addbecc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:55.520625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7eb76d-4a9d-4fc2-a5ee-e5d9addbecc0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:55.534640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 965/1938] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:55.535960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7eb76d-4a9d-4fc2-a5ee-e5d9addbecc0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:55.545939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7eb76d-4a9d-4fc2-a5ee-e5d9addbecc0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:55.558953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af1f55-ba47-498e-adf2-8cc0cd0f10f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:55.558953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1f55-ba47-498e-adf2-8cc0cd0f10f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.558953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1f55-ba47-498e-adf2-8cc0cd0f10f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.558953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af1f55-ba47-498e-adf2-8cc0cd0f10f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.559372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af1f55-ba47-498e-adf2-8cc0cd0f10f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:55.559372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af1f55-ba47-498e-adf2-8cc0cd0f10f2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:55.574721 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 966/1939] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:55.575790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af1f55-ba47-498e-adf2-8cc0cd0f10f2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:55.586134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af1f55-ba47-498e-adf2-8cc0cd0f10f2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:55.591417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b6868-36d5-4a44-bd47-b765084f4446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:55.592068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6868-36d5-4a44-bd47-b765084f4446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.592343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6868-36d5-4a44-bd47-b765084f4446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.592831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6868-36d5-4a44-bd47-b765084f4446 admin admin] PATH_INFO: `/v3/projects/619011cf607d4f88a3091f9b444b5288/users/8a3e90f4e4f24b0bb3ac7f80670291b1/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.607925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b6868-36d5-4a44-bd47-b765084f4446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619011cf607d4f88a3091f9b444b5288, user_id=8a3e90f4e4f24b0bb3ac7f80670291b1, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:55.610889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b6868-36d5-4a44-bd47-b765084f4446 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:55.622275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e71f89cd564e1a98523d5f9b1a4537'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:55.622951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e71f89cd564e1a98523d5f9b1a4537'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:55.698153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e71f89cd564e1a98523d5f9b1a4537'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:55.698976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e71f89cd564e1a98523d5f9b1a4537'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:55.704469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 967/1940] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:55 2022] PUT /identity/v3/projects/619011cf607d4f88a3091f9b444b5288/users/8a3e90f4e4f24b0bb3ac7f80670291b1/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:55.714684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e71f89cd564e1a98523d5f9b1a4537'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:55.715981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ba21-be7d-4bc5-ad94-1284dc6d1bcb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.716320 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ba21-be7d-4bc5-ad94-1284dc6d1bcb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.716537 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ba21-be7d-4bc5-ad94-1284dc6d1bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.729063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 974/1941] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:55 2022] DELETE /identity/v3/users/e1e71f89cd564e1a98523d5f9b1a4537 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:55.744673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-be14ba21-be7d-4bc5-ad94-1284dc6d1bcb None None] MFA Rules not processed for user `8a3e90f4e4f24b0bb3ac7f80670291b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:55.745920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be14ba21-be7d-4bc5-ad94-1284dc6d1bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:55.834926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 968/1942] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:55.840148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:55.841956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:55.910908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c438b5-57ce-4449-9ba7-6c4c869895dc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:55.916472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a184ffb-0bc3-4758-9e5a-8172a0db6dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:55.917097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a184ffb-0bc3-4758-9e5a-8172a0db6dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:55.917425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a184ffb-0bc3-4758-9e5a-8172a0db6dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:55.917699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a184ffb-0bc3-4758-9e5a-8172a0db6dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:55.920137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:55.921650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a184ffb-0bc3-4758-9e5a-8172a0db6dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:55.923656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a184ffb-0bc3-4758-9e5a-8172a0db6dd0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:56.021567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 975/1943] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:55 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:56.022446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14ba21-be7d-4bc5-ad94-1284dc6d1bcb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.035589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14ba21-be7d-4bc5-ad94-1284dc6d1bcb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:56.095391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b776-a2d5-403a-9222-6fd2c4b38115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:56.096024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b776-a2d5-403a-9222-6fd2c4b38115 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.096308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b776-a2d5-403a-9222-6fd2c4b38115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.096584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b776-a2d5-403a-9222-6fd2c4b38115 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.097302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2b776-a2d5-403a-9222-6fd2c4b38115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:56.099311 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2b776-a2d5-403a-9222-6fd2c4b38115 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:56.207769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 969/1944] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:56 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:56.212202 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a184ffb-0bc3-4758-9e5a-8172a0db6dd0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.224345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a184ffb-0bc3-4758-9e5a-8172a0db6dd0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:56.231146 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608831-3268-4ec0-8c79-3c7929f84063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:56.231911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608831-3268-4ec0-8c79-3c7929f84063 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.232266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608831-3268-4ec0-8c79-3c7929f84063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.232618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea608831-3268-4ec0-8c79-3c7929f84063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.233680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea608831-3268-4ec0-8c79-3c7929f84063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:56.235702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea608831-3268-4ec0-8c79-3c7929f84063 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:56.244617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b776-a2d5-403a-9222-6fd2c4b38115 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.249212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 976/1945] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:38:56.253533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608831-3268-4ec0-8c79-3c7929f84063 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.258884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4dd2b776-a2d5-403a-9222-6fd2c4b38115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:56.272215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b776-a2d5-403a-9222-6fd2c4b38115 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:56.274939 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea608831-3268-4ec0-8c79-3c7929f84063 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:56.277510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:56.278166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.278612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.278880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] PATH_INFO: `/v3/projects/807830b808314a4daa965992107047fc` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.280315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807830b808314a4daa965992107047fc)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:56.282274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:56.282536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b976916-6a09-4704-af85-786b9b71a068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:56.283655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b976916-6a09-4704-af85-786b9b71a068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.284499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b976916-6a09-4704-af85-786b9b71a068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.285565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b976916-6a09-4704-af85-786b9b71a068 admin admin] PATH_INFO: `/v3/projects/0cfebbc0eb5b4290a8c91471095e854f/users/b937be7ab3474ff3bb7287cab35c3b7c/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.307940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b976916-6a09-4704-af85-786b9b71a068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cfebbc0eb5b4290a8c91471095e854f, user_id=b937be7ab3474ff3bb7287cab35c3b7c, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:56.311884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b976916-6a09-4704-af85-786b9b71a068 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:56.449840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 977/1946] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:56 2022] PUT /identity/v3/projects/0cfebbc0eb5b4290a8c91471095e854f/users/b937be7ab3474ff3bb7287cab35c3b7c/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:56.453759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b976916-6a09-4704-af85-786b9b71a068 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.460841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807830b808314a4daa965992107047fc', 'request_id': 'req-c56551b9-c622-4fe1-93e9-f20bc17b9a61'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.472136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807830b808314a4daa965992107047fc', 'request_id': 'req-c56551b9-c622-4fe1-93e9-f20bc17b9a61'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.481976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807830b808314a4daa965992107047fc', 'request_id': 'req-c56551b9-c622-4fe1-93e9-f20bc17b9a61'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.565889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b976916-6a09-4704-af85-786b9b71a068 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:56.628002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] The token cache is being invalidate because project 807830b808314a4daa965992107047fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:38:56.628189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.628852 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c56551b9-c622-4fe1-93e9-f20bc17b9a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:38:56.630927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 970/1947] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:38:56 2022] DELETE /identity/v3/projects/807830b808314a4daa965992107047fc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:56.632536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13669f7-dc8b-4db2-8efa-8eaa051d5a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:56.633501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13669f7-dc8b-4db2-8efa-8eaa051d5a62 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.633687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13669f7-dc8b-4db2-8efa-8eaa051d5a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.634160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13669f7-dc8b-4db2-8efa-8eaa051d5a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.634863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13669f7-dc8b-4db2-8efa-8eaa051d5a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:56.636541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13669f7-dc8b-4db2-8efa-8eaa051d5a62 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:56.637980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad0b9-8b16-4c62-96db-a0b133f3f1a6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.646659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad0b9-8b16-4c62-96db-a0b133f3f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.646659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad0b9-8b16-4c62-96db-a0b133f3f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.648192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 978/1948] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:56.653008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13669f7-dc8b-4db2-8efa-8eaa051d5a62 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.658424 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d13669f7-dc8b-4db2-8efa-8eaa051d5a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:56.675020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-927ad0b9-8b16-4c62-96db-a0b133f3f1a6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:56.688319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13669f7-dc8b-4db2-8efa-8eaa051d5a62 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:56.695376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-927ad0b9-8b16-4c62-96db-a0b133f3f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:56.698726 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefacf1-1c49-4aa9-8d56-8d6b0975680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:56.699617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefacf1-1c49-4aa9-8d56-8d6b0975680e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.699973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefacf1-1c49-4aa9-8d56-8d6b0975680e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.700472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefacf1-1c49-4aa9-8d56-8d6b0975680e admin admin] PATH_INFO: `/v3/projects/0cfebbc0eb5b4290a8c91471095e854f/users/b937be7ab3474ff3bb7287cab35c3b7c/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.714677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefacf1-1c49-4aa9-8d56-8d6b0975680e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cfebbc0eb5b4290a8c91471095e854f, user_id=b937be7ab3474ff3bb7287cab35c3b7c, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:56.717571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefacf1-1c49-4aa9-8d56-8d6b0975680e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:56.730687 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 971/1949] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:56.736223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 979/1950] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:56 2022] PUT /identity/v3/projects/0cfebbc0eb5b4290a8c91471095e854f/users/b937be7ab3474ff3bb7287cab35c3b7c/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:38:56.739196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053319e-4566-4aca-80ce-4c8f8eb4fe39 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.744421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053319e-4566-4aca-80ce-4c8f8eb4fe39 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.744421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053319e-4566-4aca-80ce-4c8f8eb4fe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.754134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382820b-722c-428d-908f-c181c31a11b8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.759058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382820b-722c-428d-908f-c181c31a11b8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.759415 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382820b-722c-428d-908f-c181c31a11b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.779284 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6053319e-4566-4aca-80ce-4c8f8eb4fe39 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:56.780693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6053319e-4566-4aca-80ce-4c8f8eb4fe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:56.817844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d382820b-722c-428d-908f-c181c31a11b8 None None] MFA Rules not processed for user `b937be7ab3474ff3bb7287cab35c3b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:56.819205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d382820b-722c-428d-908f-c181c31a11b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:56.870868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 972/1951] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:56.874866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053319e-4566-4aca-80ce-4c8f8eb4fe39 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.881676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:56.885486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053319e-4566-4aca-80ce-4c8f8eb4fe39 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:56.893879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446af5e-0873-4d8f-9f3c-127099473669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:56.894570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446af5e-0873-4d8f-9f3c-127099473669 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.894857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446af5e-0873-4d8f-9f3c-127099473669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.895134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446af5e-0873-4d8f-9f3c-127099473669 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.895846 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446af5e-0873-4d8f-9f3c-127099473669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:38:56.896159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446af5e-0873-4d8f-9f3c-127099473669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:56.897846 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446af5e-0873-4d8f-9f3c-127099473669 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:56.901855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 980/1952] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:38:56.911287 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 973/1953] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:38:56.924207 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382820b-722c-428d-908f-c181c31a11b8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.933963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446af5e-0873-4d8f-9f3c-127099473669 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:56.935728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9446af5e-0873-4d8f-9f3c-127099473669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:56.938430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382820b-722c-428d-908f-c181c31a11b8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:56.943309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674c7a6-f5db-4ac5-869e-02ed5603f4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:56.943923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c7a6-f5db-4ac5-869e-02ed5603f4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.944251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c7a6-f5db-4ac5-869e-02ed5603f4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.944529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c7a6-f5db-4ac5-869e-02ed5603f4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:56.945217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674c7a6-f5db-4ac5-869e-02ed5603f4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:56.948005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674c7a6-f5db-4ac5-869e-02ed5603f4a1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:56.994888 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446af5e-0873-4d8f-9f3c-127099473669 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:56.998713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d57ff-bd85-47fa-9172-94a8804b25df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:56.999418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d57ff-bd85-47fa-9172-94a8804b25df service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:56.999609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d57ff-bd85-47fa-9172-94a8804b25df service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:56.999886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d57ff-bd85-47fa-9172-94a8804b25df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.001692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-474d57ff-bd85-47fa-9172-94a8804b25df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:57.052832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 981/1954] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:56 2022] POST /identity/v3/projects => generated 401 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:57.057691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674c7a6-f5db-4ac5-869e-02ed5603f4a1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.077002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d57ff-bd85-47fa-9172-94a8804b25df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.078547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d57ff-bd85-47fa-9172-94a8804b25df service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.110325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 974/1955] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:57.142258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674c7a6-f5db-4ac5-869e-02ed5603f4a1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.148297 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3777e-7c73-4e8e-8a9e-9eb0602a8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.149936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3777e-7c73-4e8e-8a9e-9eb0602a8ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.150881 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3777e-7c73-4e8e-8a9e-9eb0602a8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.151265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3777e-7c73-4e8e-8a9e-9eb0602a8ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.152078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3777e-7c73-4e8e-8a9e-9eb0602a8ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.160801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3777e-7c73-4e8e-8a9e-9eb0602a8ea4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.269999 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 982/1956] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/users => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:57.274274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d57ff-bd85-47fa-9172-94a8804b25df service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.284734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d57ff-bd85-47fa-9172-94a8804b25df service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.290336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71966fa-280d-4f04-82a2-ece29007a568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.291125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71966fa-280d-4f04-82a2-ece29007a568 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.291406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71966fa-280d-4f04-82a2-ece29007a568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.296631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71966fa-280d-4f04-82a2-ece29007a568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.296631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71966fa-280d-4f04-82a2-ece29007a568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.296631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71966fa-280d-4f04-82a2-ece29007a568 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.308584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 975/1957] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:57.310219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3777e-7c73-4e8e-8a9e-9eb0602a8ea4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.322088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3777e-7c73-4e8e-8a9e-9eb0602a8ea4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.327249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779e751-0ea1-4493-8fa8-7324e9daaa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.328003 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779e751-0ea1-4493-8fa8-7324e9daaa0f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.328292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779e751-0ea1-4493-8fa8-7324e9daaa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.328569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779e751-0ea1-4493-8fa8-7324e9daaa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.329345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779e751-0ea1-4493-8fa8-7324e9daaa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.331102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779e751-0ea1-4493-8fa8-7324e9daaa0f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.342307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 983/1958] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:57.346655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71966fa-280d-4f04-82a2-ece29007a568 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.358214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71966fa-280d-4f04-82a2-ece29007a568 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.364153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d48115-305b-422f-8e0f-a2d1b3ce838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.365002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d48115-305b-422f-8e0f-a2d1b3ce838d admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.365590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d48115-305b-422f-8e0f-a2d1b3ce838d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.365971 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d48115-305b-422f-8e0f-a2d1b3ce838d admin admin] PATH_INFO: `/v3/projects/fc118ec452414acfb6bb2531bc758a48/users/173087f543dc4ffd9f9662282e7c4d95/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.382410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d48115-305b-422f-8e0f-a2d1b3ce838d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc118ec452414acfb6bb2531bc758a48, user_id=173087f543dc4ffd9f9662282e7c4d95, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.385442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d48115-305b-422f-8e0f-a2d1b3ce838d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.390972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:57.475842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 976/1959] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:57 2022] PUT /identity/v3/projects/fc118ec452414acfb6bb2531bc758a48/users/173087f543dc4ffd9f9662282e7c4d95/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:57.486870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a4bb-1909-47ad-89aa-fc7a919e682c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.487157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a4bb-1909-47ad-89aa-fc7a919e682c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.487430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a4bb-1909-47ad-89aa-fc7a919e682c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.528759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bf20a4bb-1909-47ad-89aa-fc7a919e682c None None] MFA Rules not processed for user `173087f543dc4ffd9f9662282e7c4d95`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:57.529234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bf20a4bb-1909-47ad-89aa-fc7a919e682c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:57.608473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 984/1960] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:57.613556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d48115-305b-422f-8e0f-a2d1b3ce838d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.687300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d48115-305b-422f-8e0f-a2d1b3ce838d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.691965 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647f50-be21-49be-83e5-e4a099d544b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.692582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647f50-be21-49be-83e5-e4a099d544b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.692864 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647f50-be21-49be-83e5-e4a099d544b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.693148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647f50-be21-49be-83e5-e4a099d544b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.693826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01647f50-be21-49be-83e5-e4a099d544b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.696310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01647f50-be21-49be-83e5-e4a099d544b1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:57.848276 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20a4bb-1909-47ad-89aa-fc7a919e682c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:57.856024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 977/1961] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/projects => generated 401 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:38:57.862803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20a4bb-1909-47ad-89aa-fc7a919e682c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:57.942684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa615f9d-4c72-4554-bfef-fab182d1b008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:57.946327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa615f9d-4c72-4554-bfef-fab182d1b008 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:57.946327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa615f9d-4c72-4554-bfef-fab182d1b008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:57.946327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa615f9d-4c72-4554-bfef-fab182d1b008 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:57.946327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa615f9d-4c72-4554-bfef-fab182d1b008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:57.947133 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa615f9d-4c72-4554-bfef-fab182d1b008 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.045594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 985/1962] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:38:57 2022] POST /identity/v3/users => generated 307 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:38:58.049160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647f50-be21-49be-83e5-e4a099d544b1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.066260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647f50-be21-49be-83e5-e4a099d544b1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.074339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d7198-d3c0-4de8-a4e8-95ed8788b395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.074339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d7198-d3c0-4de8-a4e8-95ed8788b395 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.074339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d7198-d3c0-4de8-a4e8-95ed8788b395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.074339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d7198-d3c0-4de8-a4e8-95ed8788b395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.075216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d7198-d3c0-4de8-a4e8-95ed8788b395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.076810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d7198-d3c0-4de8-a4e8-95ed8788b395 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.089387 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 978/1963] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:58.093301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa615f9d-4c72-4554-bfef-fab182d1b008 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.107305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa615f9d-4c72-4554-bfef-fab182d1b008 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.112138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949854a-0594-4670-a549-446222126b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.112871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949854a-0594-4670-a549-446222126b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.113096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949854a-0594-4670-a549-446222126b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.113427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949854a-0594-4670-a549-446222126b31 admin admin] PATH_INFO: `/v3/projects/1fc613afd9c142188cf8710750e3fc79/users/37ed5d9f17394903880d2898afca43ce/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.147847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949854a-0594-4670-a549-446222126b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc613afd9c142188cf8710750e3fc79, user_id=37ed5d9f17394903880d2898afca43ce, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.161642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949854a-0594-4670-a549-446222126b31 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.188835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:58.285392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 986/1964] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:58 2022] PUT /identity/v3/projects/1fc613afd9c142188cf8710750e3fc79/users/37ed5d9f17394903880d2898afca43ce/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:58.286628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d7198-d3c0-4de8-a4e8-95ed8788b395 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.296968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d7198-d3c0-4de8-a4e8-95ed8788b395 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.363810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0c5c4-b2a2-471e-a2b2-bb22f30abbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.364349 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0c5c4-b2a2-471e-a2b2-bb22f30abbcc admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.364679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0c5c4-b2a2-471e-a2b2-bb22f30abbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.364955 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0c5c4-b2a2-471e-a2b2-bb22f30abbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.365695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0c5c4-b2a2-471e-a2b2-bb22f30abbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.367316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0c5c4-b2a2-471e-a2b2-bb22f30abbcc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.378329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 979/1965] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:38:58.382565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949854a-0594-4670-a549-446222126b31 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.394049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949854a-0594-4670-a549-446222126b31 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.400148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac298b-fa70-4849-8483-fedd8d6c64d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.408077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac298b-fa70-4849-8483-fedd8d6c64d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.408077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac298b-fa70-4849-8483-fedd8d6c64d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.408077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac298b-fa70-4849-8483-fedd8d6c64d6 admin admin] PATH_INFO: `/v3/projects/1fc613afd9c142188cf8710750e3fc79/users/37ed5d9f17394903880d2898afca43ce/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.408077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac298b-fa70-4849-8483-fedd8d6c64d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc613afd9c142188cf8710750e3fc79, user_id=37ed5d9f17394903880d2898afca43ce, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.408077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac298b-fa70-4849-8483-fedd8d6c64d6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.419428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 987/1966] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:38:58 2022] PUT /identity/v3/projects/1fc613afd9c142188cf8710750e3fc79/users/37ed5d9f17394903880d2898afca43ce/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:38:58.434284 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4894600-d852-41b3-9868-645a396d3f56 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.434532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4894600-d852-41b3-9868-645a396d3f56 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.439731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4894600-d852-41b3-9868-645a396d3f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.466932 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d4894600-d852-41b3-9868-645a396d3f56 None None] MFA Rules not processed for user `37ed5d9f17394903880d2898afca43ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:38:58.468461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d4894600-d852-41b3-9868-645a396d3f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:38:58.549407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 980/1967] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:38:58 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:38:58.562123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac298b-fa70-4849-8483-fedd8d6c64d6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.567276 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:58.634690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac298b-fa70-4849-8483-fedd8d6c64d6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.639603 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df559-e952-4315-81a9-28d60118d88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.640292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df559-e952-4315-81a9-28d60118d88e service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.640766 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df559-e952-4315-81a9-28d60118d88e service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.645113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45df559-e952-4315-81a9-28d60118d88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:58.651189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45df559-e952-4315-81a9-28d60118d88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:58.652625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45df559-e952-4315-81a9-28d60118d88e service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:58.663414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 988/1968] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:38:58.981100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4894600-d852-41b3-9868-645a396d3f56 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:58.990468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4894600-d852-41b3-9868-645a396d3f56 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:38:58.994282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c8945-1336-4144-9385-532797e52f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:38:58.994898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c8945-1336-4144-9385-532797e52f8b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:38:58.995181 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c8945-1336-4144-9385-532797e52f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:38:58.995456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c8945-1336-4144-9385-532797e52f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:38:59.059422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c8945-1336-4144-9385-532797e52f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:38:59.060937 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c8945-1336-4144-9385-532797e52f8b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:38:59.071583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 981/1969] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:38:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:38:59.448940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:59.708625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:38:59.964855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df559-e952-4315-81a9-28d60118d88e service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:38:59.969896 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f45df559-e952-4315-81a9-28d60118d88e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:00.036568 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45df559-e952-4315-81a9-28d60118d88e service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:00.042599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:00.043547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:00.043547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:00.043797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] PATH_INFO: `/v3/users/9dd82d62ae3b4d0b8d803b556a6d0158` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:00.044928 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd82d62ae3b4d0b8d803b556a6d0158)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:00.047092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:00.225981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd82d62ae3b4d0b8d803b556a6d0158'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.226948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd82d62ae3b4d0b8d803b556a6d0158'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.303563 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd82d62ae3b4d0b8d803b556a6d0158'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.304590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd82d62ae3b4d0b8d803b556a6d0158'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.324171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd82d62ae3b4d0b8d803b556a6d0158'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.338598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 989/1970] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:38:59 2022] DELETE /identity/v3/users/9dd82d62ae3b4d0b8d803b556a6d0158 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:00.343698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46627f-ba1c-4238-800b-6dd48a03b22c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:00.344102 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46627f-ba1c-4238-800b-6dd48a03b22c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:00.344391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46627f-ba1c-4238-800b-6dd48a03b22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:00.364330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6f46627f-ba1c-4238-800b-6dd48a03b22c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:00.365745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6f46627f-ba1c-4238-800b-6dd48a03b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:00.435516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 982/1971] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:00.445443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:00.448227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:00.473689 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:00.514166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529e859-9c6e-4409-9678-38b3cc76f8c9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:00.518203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420a66a-34eb-47f5-bc21-2b03884fb5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:00.518708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a66a-34eb-47f5-bc21-2b03884fb5cb service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:00.519016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a66a-34eb-47f5-bc21-2b03884fb5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:00.519533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a66a-34eb-47f5-bc21-2b03884fb5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:00.530211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420a66a-34eb-47f5-bc21-2b03884fb5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:00.531725 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420a66a-34eb-47f5-bc21-2b03884fb5cb service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:00.543446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 990/1972] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:00.563571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46627f-ba1c-4238-800b-6dd48a03b22c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:00.567977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6f46627f-ba1c-4238-800b-6dd48a03b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:00.578767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46627f-ba1c-4238-800b-6dd48a03b22c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:00.583724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:00.584492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:00.584825 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:00.585098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] PATH_INFO: `/v3/users/8a3e90f4e4f24b0bb3ac7f80670291b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:00.587128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3e90f4e4f24b0bb3ac7f80670291b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:00.589283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:00.623191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:00.846009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3e90f4e4f24b0bb3ac7f80670291b1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.947858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3e90f4e4f24b0bb3ac7f80670291b1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.948736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3e90f4e4f24b0bb3ac7f80670291b1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.949383 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3e90f4e4f24b0bb3ac7f80670291b1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.965064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3e90f4e4f24b0bb3ac7f80670291b1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:00.978893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 983/1973] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:00 2022] DELETE /identity/v3/users/8a3e90f4e4f24b0bb3ac7f80670291b1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:00.984763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fdbdc-6fa4-42d7-9b19-79caff36860d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:00.985053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fdbdc-6fa4-42d7-9b19-79caff36860d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:00.985366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fdbdc-6fa4-42d7-9b19-79caff36860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:01.006755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f6fdbdc-6fa4-42d7-9b19-79caff36860d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:01.008008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f6fdbdc-6fa4-42d7-9b19-79caff36860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:01.100426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 991/1974] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:01.111604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:01.113147 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:01.180604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b726c3d-770a-452f-bf46-e38992d3f4c5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:01.184446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0f940-05a9-42e7-a51b-028ff52616c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:01.185046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0f940-05a9-42e7-a51b-028ff52616c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:01.185351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0f940-05a9-42e7-a51b-028ff52616c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:01.185621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0f940-05a9-42e7-a51b-028ff52616c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:01.194786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0f940-05a9-42e7-a51b-028ff52616c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:01.196917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0f940-05a9-42e7-a51b-028ff52616c3 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:01.210116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 984/1975] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:01.669091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fdbdc-6fa4-42d7-9b19-79caff36860d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:01.670805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f6fdbdc-6fa4-42d7-9b19-79caff36860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:01.684422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fdbdc-6fa4-42d7-9b19-79caff36860d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:01.689039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:01.689735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:01.694092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:01.694092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] PATH_INFO: `/v3/projects/c9b002fbe4b34769b19754f3902e7069` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:01.694092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b002fbe4b34769b19754f3902e7069)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:01.694092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:01.723218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0f940-05a9-42e7-a51b-028ff52616c3 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:01.724802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3ea0f940-05a9-42e7-a51b-028ff52616c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:01.744054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0f940-05a9-42e7-a51b-028ff52616c3 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:01.750211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:01.751967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:01.751967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:01.751967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] PATH_INFO: `/v3/projects/619011cf607d4f88a3091f9b444b5288` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:01.753575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=619011cf607d4f88a3091f9b444b5288)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:01.756168 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:01.817910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b002fbe4b34769b19754f3902e7069', 'request_id': 'req-3a6e661b-27e0-4dfb-8273-f1850b539acc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.824525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b002fbe4b34769b19754f3902e7069', 'request_id': 'req-3a6e661b-27e0-4dfb-8273-f1850b539acc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.830766 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b002fbe4b34769b19754f3902e7069', 'request_id': 'req-3a6e661b-27e0-4dfb-8273-f1850b539acc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.908252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619011cf607d4f88a3091f9b444b5288', 'request_id': 'req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.917162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619011cf607d4f88a3091f9b444b5288', 'request_id': 'req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.917335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] The token cache is being invalidate because project c9b002fbe4b34769b19754f3902e7069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:01.917467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.918134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a6e661b-27e0-4dfb-8273-f1850b539acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.919704 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 992/1976] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:01 2022] DELETE /identity/v3/projects/c9b002fbe4b34769b19754f3902e7069 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:01.927268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619011cf607d4f88a3091f9b444b5288', 'request_id': 'req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:01.931606 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a535585-97bb-4523-b894-49929b385ed9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:01.932779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a535585-97bb-4523-b894-49929b385ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:01.933281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a535585-97bb-4523-b894-49929b385ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:01.955696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5a535585-97bb-4523-b894-49929b385ed9 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:01.956912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a535585-97bb-4523-b894-49929b385ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:02.023173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] The token cache is being invalidate because project 619011cf607d4f88a3091f9b444b5288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:02.023421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.025261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.029252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 985/1977] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:01 2022] DELETE /identity/v3/projects/619011cf607d4f88a3091f9b444b5288 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:02.030052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 993/1978] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:02.032248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:02.033912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:02.038672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f9d34-ad02-4d3d-8018-6ccf5e91ff3e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.041174 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f9d34-ad02-4d3d-8018-6ccf5e91ff3e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.041616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f9d34-ad02-4d3d-8018-6ccf5e91ff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.063788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-219f9d34-ad02-4d3d-8018-6ccf5e91ff3e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:02.065259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1e8ed-dbe9-41cb-bbc7-840952e6e7bc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:02.066435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-219f9d34-ad02-4d3d-8018-6ccf5e91ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:02.076208 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:02.078161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 994/1979] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:02.083255 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f9d34-ad02-4d3d-8018-6ccf5e91ff3e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:02.084343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.084637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.084967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] PATH_INFO: `/v3/users/b937be7ab3474ff3bb7287cab35c3b7c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.089566 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b937be7ab3474ff3bb7287cab35c3b7c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:02.094096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:02.102632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f9d34-ad02-4d3d-8018-6ccf5e91ff3e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:02.110275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0e3fd-69c0-4f4b-98f8-57896afe061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:02.112519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e3fd-69c0-4f4b-98f8-57896afe061c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.112808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e3fd-69c0-4f4b-98f8-57896afe061c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.125382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e3fd-69c0-4f4b-98f8-57896afe061c admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.125382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0e3fd-69c0-4f4b-98f8-57896afe061c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:02.125382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0e3fd-69c0-4f4b-98f8-57896afe061c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:02.125382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0e3fd-69c0-4f4b-98f8-57896afe061c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:02.146779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 995/1980] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:02.150676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:02.157707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0e3fd-69c0-4f4b-98f8-57896afe061c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:02.185873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0e3fd-69c0-4f4b-98f8-57896afe061c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:02.194479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b9f6c-542b-4d6e-9798-d6cc2d4a43f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:02.195904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b9f6c-542b-4d6e-9798-d6cc2d4a43f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.197039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b9f6c-542b-4d6e-9798-d6cc2d4a43f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.197441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b9f6c-542b-4d6e-9798-d6cc2d4a43f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.198291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b9f6c-542b-4d6e-9798-d6cc2d4a43f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:02.200778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b9f6c-542b-4d6e-9798-d6cc2d4a43f6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:02.201729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:02.314846 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 996/1981] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:02 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:02.316232 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b9f6c-542b-4d6e-9798-d6cc2d4a43f6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:02.355589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b937be7ab3474ff3bb7287cab35c3b7c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.397562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b9f6c-542b-4d6e-9798-d6cc2d4a43f6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:02.403001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a50ac-1400-4f98-9974-0676b0308f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:02.403630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a50ac-1400-4f98-9974-0676b0308f7f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.403911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a50ac-1400-4f98-9974-0676b0308f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.404238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a50ac-1400-4f98-9974-0676b0308f7f admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.405085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a50ac-1400-4f98-9974-0676b0308f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:02.407121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a50ac-1400-4f98-9974-0676b0308f7f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:02.475383 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b937be7ab3474ff3bb7287cab35c3b7c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.476112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b937be7ab3474ff3bb7287cab35c3b7c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.478225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b937be7ab3474ff3bb7287cab35c3b7c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.514119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 997/1982] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:02 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:02.515029 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a50ac-1400-4f98-9974-0676b0308f7f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:02.516931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c45a50ac-1400-4f98-9974-0676b0308f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:02.525901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b937be7ab3474ff3bb7287cab35c3b7c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:02.531484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a50ac-1400-4f98-9974-0676b0308f7f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:02.545629 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef258c77-f2f0-4323-bfe6-d11e952eb5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:02.546580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef258c77-f2f0-4323-bfe6-d11e952eb5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.547027 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef258c77-f2f0-4323-bfe6-d11e952eb5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.547300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef258c77-f2f0-4323-bfe6-d11e952eb5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.548174 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef258c77-f2f0-4323-bfe6-d11e952eb5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:02.549977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef258c77-f2f0-4323-bfe6-d11e952eb5e0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:02.575403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 986/1983] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:02 2022] DELETE /identity/v3/users/b937be7ab3474ff3bb7287cab35c3b7c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:02.585216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 998/1984] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:02.587077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:02.748077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f79df4-fe63-4b68-b460-1f39058b5fb8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:02.759344 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102af3a6-9484-4101-9d6d-1efff1e43d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:02.768673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af3a6-9484-4101-9d6d-1efff1e43d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.768673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af3a6-9484-4101-9d6d-1efff1e43d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.768673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af3a6-9484-4101-9d6d-1efff1e43d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.768673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102af3a6-9484-4101-9d6d-1efff1e43d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:02.768673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102af3a6-9484-4101-9d6d-1efff1e43d10 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:02.791292 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 987/1985] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:02.792925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef258c77-f2f0-4323-bfe6-d11e952eb5e0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:02.803080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef258c77-f2f0-4323-bfe6-d11e952eb5e0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:02.812217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5d92d-d5aa-44c0-b127-f07c315f0629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:02.813015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5d92d-d5aa-44c0-b127-f07c315f0629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.813831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5d92d-d5aa-44c0-b127-f07c315f0629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.814308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5d92d-d5aa-44c0-b127-f07c315f0629 admin admin] PATH_INFO: `/v3/projects/577dbbb10946405f88e8a56a0fa8c670/users/2ef870e8afb64c6dbd990259dea704f9/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.837400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5d92d-d5aa-44c0-b127-f07c315f0629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577dbbb10946405f88e8a56a0fa8c670, user_id=2ef870e8afb64c6dbd990259dea704f9, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:02.841419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5d92d-d5aa-44c0-b127-f07c315f0629 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:02.962477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 999/1986] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:02 2022] PUT /identity/v3/projects/577dbbb10946405f88e8a56a0fa8c670/users/2ef870e8afb64c6dbd990259dea704f9/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:02.962739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be3bf-7ad5-4c48-a652-291b71611393 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:02.963278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be3bf-7ad5-4c48-a652-291b71611393 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:02.963278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5be3bf-7ad5-4c48-a652-291b71611393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:02.968893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:03.036325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6c5be3bf-7ad5-4c48-a652-291b71611393 None None] MFA Rules not processed for user `2ef870e8afb64c6dbd990259dea704f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:03.039297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6c5be3bf-7ad5-4c48-a652-291b71611393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:03.151465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 988/1987] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:03.156233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5d92d-d5aa-44c0-b127-f07c315f0629 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:03.251159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5d92d-d5aa-44c0-b127-f07c315f0629 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:03.256997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff4347-1f1d-4277-a8d4-5f72e90df5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:03.258429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff4347-1f1d-4277-a8d4-5f72e90df5bb admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.258904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff4347-1f1d-4277-a8d4-5f72e90df5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.259360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff4347-1f1d-4277-a8d4-5f72e90df5bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.260183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff4347-1f1d-4277-a8d4-5f72e90df5bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:03.262934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff4347-1f1d-4277-a8d4-5f72e90df5bb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:03.358511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1000/1988] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:03 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:03.362457 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be3bf-7ad5-4c48-a652-291b71611393 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:03.375881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5be3bf-7ad5-4c48-a652-291b71611393 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:03.461788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e81769-7075-461f-b93d-b4ab74ef1c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:03.461788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e81769-7075-461f-b93d-b4ab74ef1c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.461788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e81769-7075-461f-b93d-b4ab74ef1c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.462391 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e81769-7075-461f-b93d-b4ab74ef1c7d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.463299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e81769-7075-461f-b93d-b4ab74ef1c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:03.465995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e81769-7075-461f-b93d-b4ab74ef1c7d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:03.608059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 989/1989] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:03 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:03.612143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff4347-1f1d-4277-a8d4-5f72e90df5bb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:03.624192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff4347-1f1d-4277-a8d4-5f72e90df5bb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:03.629507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e187ea7-3938-4d56-b6c1-5543d06e5294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:03.630590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e187ea7-3938-4d56-b6c1-5543d06e5294 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.631014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e187ea7-3938-4d56-b6c1-5543d06e5294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.631428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e187ea7-3938-4d56-b6c1-5543d06e5294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.632284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e187ea7-3938-4d56-b6c1-5543d06e5294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:03.634810 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e187ea7-3938-4d56-b6c1-5543d06e5294 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:03.651965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1001/1990] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:03.655722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e81769-7075-461f-b93d-b4ab74ef1c7d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:03.667938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e81769-7075-461f-b93d-b4ab74ef1c7d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:03.673366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f187550-ff48-47d3-8819-589fc7c52033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:03.675958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f187550-ff48-47d3-8819-589fc7c52033 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.675958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f187550-ff48-47d3-8819-589fc7c52033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.675958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f187550-ff48-47d3-8819-589fc7c52033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.675958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f187550-ff48-47d3-8819-589fc7c52033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:03.677492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f187550-ff48-47d3-8819-589fc7c52033 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:03.693179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 990/1991] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:03.697387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e187ea7-3938-4d56-b6c1-5543d06e5294 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:03.712488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e187ea7-3938-4d56-b6c1-5543d06e5294 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:03.718595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653846-b6b5-4772-a254-af31c13d6575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:03.719411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653846-b6b5-4772-a254-af31c13d6575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.721612 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653846-b6b5-4772-a254-af31c13d6575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.721993 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653846-b6b5-4772-a254-af31c13d6575 admin admin] PATH_INFO: `/v3/projects/c2d534772eb94d6a8923b94717534ac5/users/3bce1097824e4706b147accc77f64aa2/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.750305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653846-b6b5-4772-a254-af31c13d6575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d534772eb94d6a8923b94717534ac5, user_id=3bce1097824e4706b147accc77f64aa2, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:03.753577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653846-b6b5-4772-a254-af31c13d6575 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:03.860873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1002/1992] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:03 2022] PUT /identity/v3/projects/c2d534772eb94d6a8923b94717534ac5/users/3bce1097824e4706b147accc77f64aa2/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:03.875196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1b460-9ab2-4ba1-916c-bbc62c36210d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:03.875721 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1b460-9ab2-4ba1-916c-bbc62c36210d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:03.876026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1b460-9ab2-4ba1-916c-bbc62c36210d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:03.909429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f4f1b460-9ab2-4ba1-916c-bbc62c36210d None None] MFA Rules not processed for user `3bce1097824e4706b147accc77f64aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:03.910901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f4f1b460-9ab2-4ba1-916c-bbc62c36210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:04.007565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 991/1993] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:04.019172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653846-b6b5-4772-a254-af31c13d6575 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.119544 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653846-b6b5-4772-a254-af31c13d6575 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.124318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10f970-eb40-41eb-9d3e-7972fafe5a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.124947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f970-eb40-41eb-9d3e-7972fafe5a76 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.125259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f970-eb40-41eb-9d3e-7972fafe5a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.125537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f970-eb40-41eb-9d3e-7972fafe5a76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.126221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10f970-eb40-41eb-9d3e-7972fafe5a76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.128118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10f970-eb40-41eb-9d3e-7972fafe5a76 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.134817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1b460-9ab2-4ba1-916c-bbc62c36210d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.136689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f4f1b460-9ab2-4ba1-916c-bbc62c36210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:04.154204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1b460-9ab2-4ba1-916c-bbc62c36210d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.161113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.161897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.162304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.162677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] PATH_INFO: `/v3/projects/0cfebbc0eb5b4290a8c91471095e854f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.163964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cfebbc0eb5b4290a8c91471095e854f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.166901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.266688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1003/1994] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:04 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:04.270950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10f970-eb40-41eb-9d3e-7972fafe5a76 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.283219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:04.313724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cfebbc0eb5b4290a8c91471095e854f', 'request_id': 'req-ac1d25a0-8d13-49c9-aa96-d44c291aa951'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:04.322098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cfebbc0eb5b4290a8c91471095e854f', 'request_id': 'req-ac1d25a0-8d13-49c9-aa96-d44c291aa951'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:04.332521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cfebbc0eb5b4290a8c91471095e854f', 'request_id': 'req-ac1d25a0-8d13-49c9-aa96-d44c291aa951'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:04.374827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10f970-eb40-41eb-9d3e-7972fafe5a76 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.413379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] The token cache is being invalidate because project 0cfebbc0eb5b4290a8c91471095e854f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:04.413959 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:04.415509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac1d25a0-8d13-49c9-aa96-d44c291aa951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:04.418033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 992/1995] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:04 2022] DELETE /identity/v3/projects/0cfebbc0eb5b4290a8c91471095e854f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:04.425052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080979e-faac-45c8-9fbb-ada3249096c8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.426680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080979e-faac-45c8-9fbb-ada3249096c8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.427025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080979e-faac-45c8-9fbb-ada3249096c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.450349 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5080979e-faac-45c8-9fbb-ada3249096c8 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:04.452208 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5080979e-faac-45c8-9fbb-ada3249096c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:04.463978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451503fd-94af-4ed6-8264-266987919791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.464967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451503fd-94af-4ed6-8264-266987919791 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.466077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451503fd-94af-4ed6-8264-266987919791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.466568 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451503fd-94af-4ed6-8264-266987919791 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.467839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451503fd-94af-4ed6-8264-266987919791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.474883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451503fd-94af-4ed6-8264-266987919791 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.545101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 993/1996] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:04.546878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344e22-d78c-4870-8d74-ba8f4549c3ba None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.547263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344e22-d78c-4870-8d74-ba8f4549c3ba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.547638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344e22-d78c-4870-8d74-ba8f4549c3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.560858 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1004/1997] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:04 2022] POST /identity/v3/users => generated 295 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:04.562194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451503fd-94af-4ed6-8264-266987919791 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.565261 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-451503fd-94af-4ed6-8264-266987919791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:04.571103 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cb344e22-d78c-4870-8d74-ba8f4549c3ba None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:04.572438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cb344e22-d78c-4870-8d74-ba8f4549c3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:04.578582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451503fd-94af-4ed6-8264-266987919791 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.581200 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 994/1998] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:04.585525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb344e22-d78c-4870-8d74-ba8f4549c3ba None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.585665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30053d4-401c-44c6-aee0-b4431d0f9b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.586301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30053d4-401c-44c6-aee0-b4431d0f9b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.586608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30053d4-401c-44c6-aee0-b4431d0f9b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.586863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30053d4-401c-44c6-aee0-b4431d0f9b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.587843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30053d4-401c-44c6-aee0-b4431d0f9b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.589504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30053d4-401c-44c6-aee0-b4431d0f9b27 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.594970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb344e22-d78c-4870-8d74-ba8f4549c3ba None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.599902 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1722000-d788-44e5-a3f5-a68824177cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.600520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1722000-d788-44e5-a3f5-a68824177cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.600887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1722000-d788-44e5-a3f5-a68824177cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.601079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1722000-d788-44e5-a3f5-a68824177cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.602369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1722000-d788-44e5-a3f5-a68824177cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:04.602866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1722000-d788-44e5-a3f5-a68824177cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.603683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1005/1999] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:04.605726 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30053d4-401c-44c6-aee0-b4431d0f9b27 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.618107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30053d4-401c-44c6-aee0-b4431d0f9b27 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.624586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7c7aa-20e1-4832-903f-0b7ec46d64bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.625305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1722000-d788-44e5-a3f5-a68824177cd0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.625417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7c7aa-20e1-4832-903f-0b7ec46d64bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.625886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7c7aa-20e1-4832-903f-0b7ec46d64bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.626118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7c7aa-20e1-4832-903f-0b7ec46d64bd admin admin] PATH_INFO: `/v3/projects/e66a11d10026421082accc506d7c9853/users/72823e9cf7a345f8a79e3b3d43c10f4f/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.637897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 995/2000] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:39:04.642214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1722000-d788-44e5-a3f5-a68824177cd0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.649734 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7c7aa-20e1-4832-903f-0b7ec46d64bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66a11d10026421082accc506d7c9853, user_id=72823e9cf7a345f8a79e3b3d43c10f4f, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.653473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7c7aa-20e1-4832-903f-0b7ec46d64bd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.657694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1722000-d788-44e5-a3f5-a68824177cd0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.662917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f331295-f927-437b-b02e-5935879da3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.663574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f331295-f927-437b-b02e-5935879da3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.663855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f331295-f927-437b-b02e-5935879da3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.664717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f331295-f927-437b-b02e-5935879da3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.665811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f331295-f927-437b-b02e-5935879da3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.667729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f331295-f927-437b-b02e-5935879da3aa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.719960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1006/2001] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:04 2022] PUT /identity/v3/projects/e66a11d10026421082accc506d7c9853/users/72823e9cf7a345f8a79e3b3d43c10f4f/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:04.721189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7c7aa-20e1-4832-903f-0b7ec46d64bd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.740584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 996/2002] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:04 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:04.744465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f331295-f927-437b-b02e-5935879da3aa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.806816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7c7aa-20e1-4832-903f-0b7ec46d64bd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.823667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12823f47-5afe-4415-a9aa-10c349628f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.824390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12823f47-5afe-4415-a9aa-10c349628f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.824986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12823f47-5afe-4415-a9aa-10c349628f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.825379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12823f47-5afe-4415-a9aa-10c349628f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.826173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12823f47-5afe-4415-a9aa-10c349628f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.828016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12823f47-5afe-4415-a9aa-10c349628f07 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.830549 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f331295-f927-437b-b02e-5935879da3aa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.838187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed8ea2-49ae-4df8-9ffe-798580ae6e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.839037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed8ea2-49ae-4df8-9ffe-798580ae6e3d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.839381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed8ea2-49ae-4df8-9ffe-798580ae6e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.839762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed8ea2-49ae-4df8-9ffe-798580ae6e3d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.842463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:04.842956 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed8ea2-49ae-4df8-9ffe-798580ae6e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.846797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed8ea2-49ae-4df8-9ffe-798580ae6e3d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.849102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1007/2003] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:04.861630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12823f47-5afe-4415-a9aa-10c349628f07 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:04.864921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12823f47-5afe-4415-a9aa-10c349628f07 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:04.870673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb37cb-e201-4f6a-b7cd-ca7918dee515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:04.871475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb37cb-e201-4f6a-b7cd-ca7918dee515 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.871767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb37cb-e201-4f6a-b7cd-ca7918dee515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.872043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb37cb-e201-4f6a-b7cd-ca7918dee515 admin admin] PATH_INFO: `/v3/projects/e66a11d10026421082accc506d7c9853/users/72823e9cf7a345f8a79e3b3d43c10f4f/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.874091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb37cb-e201-4f6a-b7cd-ca7918dee515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66a11d10026421082accc506d7c9853, user_id=72823e9cf7a345f8a79e3b3d43c10f4f, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:04.876772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb37cb-e201-4f6a-b7cd-ca7918dee515 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:04.888226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1008/2004] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:04 2022] PUT /identity/v3/projects/e66a11d10026421082accc506d7c9853/users/72823e9cf7a345f8a79e3b3d43c10f4f/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:04.897976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5b3fd-ef82-48d8-92dd-26e9d71b90bc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:04.898268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5b3fd-ef82-48d8-92dd-26e9d71b90bc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:04.898578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5b3fd-ef82-48d8-92dd-26e9d71b90bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:04.926817 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-62f5b3fd-ef82-48d8-92dd-26e9d71b90bc None None] MFA Rules not processed for user `72823e9cf7a345f8a79e3b3d43c10f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:04.928337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-62f5b3fd-ef82-48d8-92dd-26e9d71b90bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:04.998479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 997/2005] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:04 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:05.002238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed8ea2-49ae-4df8-9ffe-798580ae6e3d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:05.012473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1009/2006] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:05.016385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed8ea2-49ae-4df8-9ffe-798580ae6e3d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:05.085430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca456d-1abe-4790-92a3-2e0271c2599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:05.086155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca456d-1abe-4790-92a3-2e0271c2599a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:05.086523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca456d-1abe-4790-92a3-2e0271c2599a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:05.086801 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca456d-1abe-4790-92a3-2e0271c2599a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:05.087594 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca456d-1abe-4790-92a3-2e0271c2599a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:05.089233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca456d-1abe-4790-92a3-2e0271c2599a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:05.099934 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 998/2007] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:05.103805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5b3fd-ef82-48d8-92dd-26e9d71b90bc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:05.115158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5b3fd-ef82-48d8-92dd-26e9d71b90bc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:05.121902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35b2c1-113d-4c5e-8ed1-1f0b248c3a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:05.122603 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35b2c1-113d-4c5e-8ed1-1f0b248c3a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:05.122998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35b2c1-113d-4c5e-8ed1-1f0b248c3a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:05.123560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35b2c1-113d-4c5e-8ed1-1f0b248c3a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:05.124410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35b2c1-113d-4c5e-8ed1-1f0b248c3a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:05.130368 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35b2c1-113d-4c5e-8ed1-1f0b248c3a1d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:05.138347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1010/2008] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:05.142686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca456d-1abe-4790-92a3-2e0271c2599a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:05.162265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca456d-1abe-4790-92a3-2e0271c2599a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:05.163691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35b2c1-113d-4c5e-8ed1-1f0b248c3a1d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:05.167495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-de35b2c1-113d-4c5e-8ed1-1f0b248c3a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:05.175084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e1253-9a30-41cf-a41a-d4b9aa388c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:05.175911 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e1253-9a30-41cf-a41a-d4b9aa388c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:05.176682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e1253-9a30-41cf-a41a-d4b9aa388c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:05.176682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e1253-9a30-41cf-a41a-d4b9aa388c19 admin admin] PATH_INFO: `/v3/projects/6406111471434836bd443bafa78d2e04/users/28831626fd594dc281d1ddd1aa3bab2b/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:05.199637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e1253-9a30-41cf-a41a-d4b9aa388c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6406111471434836bd443bafa78d2e04, user_id=28831626fd594dc281d1ddd1aa3bab2b, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:05.203410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e1253-9a30-41cf-a41a-d4b9aa388c19 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:05.260443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35b2c1-113d-4c5e-8ed1-1f0b248c3a1d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:05.264193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cff63e-5f19-4f2d-9980-48a520f6389a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:05.264827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff63e-5f19-4f2d-9980-48a520f6389a service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:05.265109 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff63e-5f19-4f2d-9980-48a520f6389a service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:05.265410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff63e-5f19-4f2d-9980-48a520f6389a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:05.267234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-05cff63e-5f19-4f2d-9980-48a520f6389a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:05.321174 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 999/2009] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:05 2022] PUT /identity/v3/projects/6406111471434836bd443bafa78d2e04/users/28831626fd594dc281d1ddd1aa3bab2b/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:05.323303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2bc9e-69be-4f2f-8ec7-861a464e58bc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:05.323594 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2bc9e-69be-4f2f-8ec7-861a464e58bc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:05.323870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2bc9e-69be-4f2f-8ec7-861a464e58bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:05.345597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-87b2bc9e-69be-4f2f-8ec7-861a464e58bc None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:05.345597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-87b2bc9e-69be-4f2f-8ec7-861a464e58bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:05.357386 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cff63e-5f19-4f2d-9980-48a520f6389a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:05.359390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cff63e-5f19-4f2d-9980-48a520f6389a service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:05.376006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1011/2010] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:05.376767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cff63e-5f19-4f2d-9980-48a520f6389a service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:05.383138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-05cff63e-5f19-4f2d-9980-48a520f6389a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:05.398201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cff63e-5f19-4f2d-9980-48a520f6389a service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:05.429273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1000/2011] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:05.441172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2bc9e-69be-4f2f-8ec7-861a464e58bc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:05.443072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-87b2bc9e-69be-4f2f-8ec7-861a464e58bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:05.480349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:05.482067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:05.482710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:05.482993 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] PATH_INFO: `/v3/users/173087f543dc4ffd9f9662282e7c4d95` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:05.485862 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=173087f543dc4ffd9f9662282e7c4d95)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:05.487841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:05.515737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2bc9e-69be-4f2f-8ec7-861a464e58bc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:05.522668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca80719-b7a0-422e-90e6-8db05baebe44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:05.523313 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca80719-b7a0-422e-90e6-8db05baebe44 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:05.523946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca80719-b7a0-422e-90e6-8db05baebe44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:05.524334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca80719-b7a0-422e-90e6-8db05baebe44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:05.536891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca80719-b7a0-422e-90e6-8db05baebe44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:05.538140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca80719-b7a0-422e-90e6-8db05baebe44 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:05.549853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1001/2012] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:05.787021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173087f543dc4ffd9f9662282e7c4d95'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.788775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173087f543dc4ffd9f9662282e7c4d95'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.903603 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173087f543dc4ffd9f9662282e7c4d95'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.904275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173087f543dc4ffd9f9662282e7c4d95'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.921535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173087f543dc4ffd9f9662282e7c4d95'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:05.936811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1012/2013] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:05 2022] DELETE /identity/v3/users/173087f543dc4ffd9f9662282e7c4d95 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:05.941978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21a71b-f72c-4edd-a672-8bb93f6f6026 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:05.942781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21a71b-f72c-4edd-a672-8bb93f6f6026 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:05.943068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21a71b-f72c-4edd-a672-8bb93f6f6026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:05.964936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1a21a71b-f72c-4edd-a672-8bb93f6f6026 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:05.966234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1a21a71b-f72c-4edd-a672-8bb93f6f6026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:06.040553 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1002/2014] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:06.050832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:06.052352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:06.068745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:06.138841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:06.170212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b7f0-c886-4665-9962-716d73b39c7f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:06.174562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168008-003a-444f-ad5f-b71acd46e137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:06.175193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168008-003a-444f-ad5f-b71acd46e137 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:06.175477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168008-003a-444f-ad5f-b71acd46e137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:06.175755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168008-003a-444f-ad5f-b71acd46e137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:06.197343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2168008-003a-444f-ad5f-b71acd46e137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:06.197343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2168008-003a-444f-ad5f-b71acd46e137 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:06.200386 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1013/2015] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:07.048631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21a71b-f72c-4edd-a672-8bb93f6f6026 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:07.050424 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1a21a71b-f72c-4edd-a672-8bb93f6f6026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:07.072355 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21a71b-f72c-4edd-a672-8bb93f6f6026 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:07.091206 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:07.091348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.091614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.091886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] PATH_INFO: `/v3/projects/fc118ec452414acfb6bb2531bc758a48` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.093078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc118ec452414acfb6bb2531bc758a48)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:07.095051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:07.220636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc118ec452414acfb6bb2531bc758a48', 'request_id': 'req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.229611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc118ec452414acfb6bb2531bc758a48', 'request_id': 'req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.238697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc118ec452414acfb6bb2531bc758a48', 'request_id': 'req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.375382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] The token cache is being invalidate because project fc118ec452414acfb6bb2531bc758a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:07.375948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.376751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.381730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1003/2016] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:07 2022] DELETE /identity/v3/projects/fc118ec452414acfb6bb2531bc758a48 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:07.383367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168008-003a-444f-ad5f-b71acd46e137 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:07.401812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168008-003a-444f-ad5f-b71acd46e137 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:07.474643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:07.475922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.476079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.476367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] PATH_INFO: `/v3/users/37ed5d9f17394903880d2898afca43ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.478554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ed5d9f17394903880d2898afca43ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:07.481846 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:07.571016 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:07.573016 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:07.636138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5bab3-d303-4ea3-bcd3-2022d84c4ba6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:07.639973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc735d6-3f17-4934-8fc1-a5f70073631a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:07.640485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc735d6-3f17-4934-8fc1-a5f70073631a service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.640767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc735d6-3f17-4934-8fc1-a5f70073631a service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.641203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc735d6-3f17-4934-8fc1-a5f70073631a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:07.643605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2bc735d6-3f17-4934-8fc1-a5f70073631a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:07.652431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:07.735289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc735d6-3f17-4934-8fc1-a5f70073631a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:07.737050 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc735d6-3f17-4934-8fc1-a5f70073631a service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:07.756064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1004/2017] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:07.797034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ed5d9f17394903880d2898afca43ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.798927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ed5d9f17394903880d2898afca43ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.853799 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:07.880467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ed5d9f17394903880d2898afca43ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.881302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ed5d9f17394903880d2898afca43ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.905160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ed5d9f17394903880d2898afca43ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:07.936313 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1014/2018] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:07 2022] DELETE /identity/v3/users/37ed5d9f17394903880d2898afca43ce => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:07.986121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f540103-853d-4a8e-a1ec-d6eea2700051 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:07.986440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f540103-853d-4a8e-a1ec-d6eea2700051 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:07.986662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f540103-853d-4a8e-a1ec-d6eea2700051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.029455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0f540103-853d-4a8e-a1ec-d6eea2700051 None None] MFA Rules not processed for user `28831626fd594dc281d1ddd1aa3bab2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:08.031318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0f540103-853d-4a8e-a1ec-d6eea2700051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:08.119924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1005/2019] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:08.186370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:08.187828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:08.252563 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01443791-4fcd-41f4-8d69-69403ca72d78 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:08.256445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a927bd-b6ad-4e2b-89a7-a3bcc430d36d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:08.257323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a927bd-b6ad-4e2b-89a7-a3bcc430d36d service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:08.257961 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a927bd-b6ad-4e2b-89a7-a3bcc430d36d service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:08.258421 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a927bd-b6ad-4e2b-89a7-a3bcc430d36d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.268186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a927bd-b6ad-4e2b-89a7-a3bcc430d36d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:08.269669 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a927bd-b6ad-4e2b-89a7-a3bcc430d36d service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:08.279279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1015/2020] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:08.473556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f540103-853d-4a8e-a1ec-d6eea2700051 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:08.475893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0f540103-853d-4a8e-a1ec-d6eea2700051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:08.544834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f540103-853d-4a8e-a1ec-d6eea2700051 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:08.549718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:08.550372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:08.550650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:08.550922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] PATH_INFO: `/v3/projects/1fc613afd9c142188cf8710750e3fc79` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.552086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc613afd9c142188cf8710750e3fc79)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:08.554158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:08.699304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc613afd9c142188cf8710750e3fc79', 'request_id': 'req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.705980 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc613afd9c142188cf8710750e3fc79', 'request_id': 'req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.712263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc613afd9c142188cf8710750e3fc79', 'request_id': 'req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.782973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] The token cache is being invalidate because project 1fc613afd9c142188cf8710750e3fc79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:08.783273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.785051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0fbad49f-5325-4bd8-8bf3-7e8292f0eaad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:08.785938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1006/2021] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:08 2022] DELETE /identity/v3/projects/1fc613afd9c142188cf8710750e3fc79 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:08.792274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b6dcd-052e-46d2-907e-81132ea79709 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:08.792755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b6dcd-052e-46d2-907e-81132ea79709 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:08.793025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b6dcd-052e-46d2-907e-81132ea79709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.815258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ee8b6dcd-052e-46d2-907e-81132ea79709 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:08.816447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ee8b6dcd-052e-46d2-907e-81132ea79709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:08.884811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1016/2022] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:08.896757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290751a-9099-4502-b0d9-6b7d489a1b37 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:08.897428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290751a-9099-4502-b0d9-6b7d489a1b37 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:08.897942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290751a-9099-4502-b0d9-6b7d489a1b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.932585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1290751a-9099-4502-b0d9-6b7d489a1b37 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:08.937948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1290751a-9099-4502-b0d9-6b7d489a1b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:08.951569 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1007/2023] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:08.955614 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b6dcd-052e-46d2-907e-81132ea79709 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:08.966466 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b6dcd-052e-46d2-907e-81132ea79709 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:08.971671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad4b9c-fe96-47aa-95e6-1ccff18cfd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:08.972306 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad4b9c-fe96-47aa-95e6-1ccff18cfd41 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:08.972588 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad4b9c-fe96-47aa-95e6-1ccff18cfd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:08.972856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad4b9c-fe96-47aa-95e6-1ccff18cfd41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:08.974698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad4b9c-fe96-47aa-95e6-1ccff18cfd41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:08.974812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad4b9c-fe96-47aa-95e6-1ccff18cfd41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:08.977016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad4b9c-fe96-47aa-95e6-1ccff18cfd41 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:08.992824 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1017/2024] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:08.995607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290751a-9099-4502-b0d9-6b7d489a1b37 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.008141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290751a-9099-4502-b0d9-6b7d489a1b37 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.014746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060dc7f-01f3-41f4-9fd2-6be9c0a76ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.015398 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060dc7f-01f3-41f4-9fd2-6be9c0a76ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.015733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060dc7f-01f3-41f4-9fd2-6be9c0a76ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.016810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060dc7f-01f3-41f4-9fd2-6be9c0a76ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.017642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060dc7f-01f3-41f4-9fd2-6be9c0a76ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.020467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060dc7f-01f3-41f4-9fd2-6be9c0a76ee3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.129786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1008/2025] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:08 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:09.131379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad4b9c-fe96-47aa-95e6-1ccff18cfd41 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.141539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad4b9c-fe96-47aa-95e6-1ccff18cfd41 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.209546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4074ee4-a05b-4274-b4c1-992448f239f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.210184 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4074ee4-a05b-4274-b4c1-992448f239f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.210466 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4074ee4-a05b-4274-b4c1-992448f239f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.210781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4074ee4-a05b-4274-b4c1-992448f239f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.215701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4074ee4-a05b-4274-b4c1-992448f239f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.215701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4074ee4-a05b-4274-b4c1-992448f239f3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.327362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1018/2026] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:09 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:09.331288 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060dc7f-01f3-41f4-9fd2-6be9c0a76ee3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.342489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060dc7f-01f3-41f4-9fd2-6be9c0a76ee3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.347640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcfc52-3be5-4f97-9f5b-ad733c300f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.347640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcfc52-3be5-4f97-9f5b-ad733c300f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.347896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcfc52-3be5-4f97-9f5b-ad733c300f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.348101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcfc52-3be5-4f97-9f5b-ad733c300f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.348928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcfc52-3be5-4f97-9f5b-ad733c300f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.350558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcfc52-3be5-4f97-9f5b-ad733c300f6a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.361567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1009/2027] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:09.365613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4074ee4-a05b-4274-b4c1-992448f239f3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.375650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4074ee4-a05b-4274-b4c1-992448f239f3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.380539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795f289-68cd-46f7-aeaa-c505318e16d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.381183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f289-68cd-46f7-aeaa-c505318e16d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.381514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f289-68cd-46f7-aeaa-c505318e16d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.381784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f289-68cd-46f7-aeaa-c505318e16d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.382477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795f289-68cd-46f7-aeaa-c505318e16d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.384065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795f289-68cd-46f7-aeaa-c505318e16d2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.394734 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1019/2028] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:09.399547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcfc52-3be5-4f97-9f5b-ad733c300f6a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.409476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcfc52-3be5-4f97-9f5b-ad733c300f6a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.415385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c296a6-d361-430a-863c-c2416b4e86c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.416053 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c296a6-d361-430a-863c-c2416b4e86c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.416334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c296a6-d361-430a-863c-c2416b4e86c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.416666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c296a6-d361-430a-863c-c2416b4e86c0 admin admin] PATH_INFO: `/v3/projects/e93de823c5b44b72bfe5c6a06a4b7065/users/f6e2bc76741c461a98f4d130ad60ec8d/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.433635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c296a6-d361-430a-863c-c2416b4e86c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93de823c5b44b72bfe5c6a06a4b7065, user_id=f6e2bc76741c461a98f4d130ad60ec8d, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.436615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c296a6-d361-430a-863c-c2416b4e86c0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.553520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1010/2029] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:09 2022] PUT /identity/v3/projects/e93de823c5b44b72bfe5c6a06a4b7065/users/f6e2bc76741c461a98f4d130ad60ec8d/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:09.562627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aba096-1c36-4252-ac26-7fbfa65ff966 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.562919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aba096-1c36-4252-ac26-7fbfa65ff966 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.563195 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aba096-1c36-4252-ac26-7fbfa65ff966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.595863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-19aba096-1c36-4252-ac26-7fbfa65ff966 None None] MFA Rules not processed for user `f6e2bc76741c461a98f4d130ad60ec8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:09.597124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-19aba096-1c36-4252-ac26-7fbfa65ff966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:09.670820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1020/2030] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:09.678533 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c296a6-d361-430a-863c-c2416b4e86c0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.706323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aba096-1c36-4252-ac26-7fbfa65ff966 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.707850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-19aba096-1c36-4252-ac26-7fbfa65ff966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:09.747434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c296a6-d361-430a-863c-c2416b4e86c0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.752052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9f036-63ff-4f45-9508-974357a032d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.752673 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f036-63ff-4f45-9508-974357a032d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.752963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f036-63ff-4f45-9508-974357a032d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.753273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f036-63ff-4f45-9508-974357a032d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.753956 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9f036-63ff-4f45-9508-974357a032d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.755873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9f036-63ff-4f45-9508-974357a032d5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.767234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aba096-1c36-4252-ac26-7fbfa65ff966 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.771045 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01b1ab-782d-4a2f-8c2c-cb102aedae0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.771668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01b1ab-782d-4a2f-8c2c-cb102aedae0d service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.772064 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01b1ab-782d-4a2f-8c2c-cb102aedae0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.772346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01b1ab-782d-4a2f-8c2c-cb102aedae0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.774342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a01b1ab-782d-4a2f-8c2c-cb102aedae0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:09.790659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:09.839016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01b1ab-782d-4a2f-8c2c-cb102aedae0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.840460 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01b1ab-782d-4a2f-8c2c-cb102aedae0d service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:09.850201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1021/2031] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:09.854886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1011/2032] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:09 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:09.858921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01b1ab-782d-4a2f-8c2c-cb102aedae0d service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:09.869802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01b1ab-782d-4a2f-8c2c-cb102aedae0d service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:09.925965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38dc2f-df6e-4fcc-880d-7bf08a2ebef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:09.926591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38dc2f-df6e-4fcc-880d-7bf08a2ebef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:09.926884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38dc2f-df6e-4fcc-880d-7bf08a2ebef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:09.927138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38dc2f-df6e-4fcc-880d-7bf08a2ebef1 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:09.927802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38dc2f-df6e-4fcc-880d-7bf08a2ebef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:09.930775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38dc2f-df6e-4fcc-880d-7bf08a2ebef1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.024274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1022/2033] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:09 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:10.028233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9f036-63ff-4f45-9508-974357a032d5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.038766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9f036-63ff-4f45-9508-974357a032d5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:10.044037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f488fab-f3ba-4ad3-9f86-f27691a4feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:10.044661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f488fab-f3ba-4ad3-9f86-f27691a4feda admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.044936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f488fab-f3ba-4ad3-9f86-f27691a4feda admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.050504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f488fab-f3ba-4ad3-9f86-f27691a4feda admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.050504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f488fab-f3ba-4ad3-9f86-f27691a4feda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:10.050504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f488fab-f3ba-4ad3-9f86-f27691a4feda admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.059876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1012/2034] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:10.064181 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38dc2f-df6e-4fcc-880d-7bf08a2ebef1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.074158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38dc2f-df6e-4fcc-880d-7bf08a2ebef1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:10.078773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9986740-a309-4025-8dba-690f41bf09cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:10.079556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9986740-a309-4025-8dba-690f41bf09cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.079840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9986740-a309-4025-8dba-690f41bf09cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.080126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9986740-a309-4025-8dba-690f41bf09cb admin admin] PATH_INFO: `/v3/projects/7a1f8c8de2d847dfb4169e4aecab62c1/users/30b2bb2f3438474490318a7cd69b5154/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.095136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9986740-a309-4025-8dba-690f41bf09cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1f8c8de2d847dfb4169e4aecab62c1, user_id=30b2bb2f3438474490318a7cd69b5154, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:10.097863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9986740-a309-4025-8dba-690f41bf09cb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.132916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:10.171294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1023/2035] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:10 2022] PUT /identity/v3/projects/7a1f8c8de2d847dfb4169e4aecab62c1/users/30b2bb2f3438474490318a7cd69b5154/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:10.178258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f488fab-f3ba-4ad3-9f86-f27691a4feda admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.188618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f488fab-f3ba-4ad3-9f86-f27691a4feda admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:10.246229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be53fcb-c1c3-4ab0-8273-09dffe0f1651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:10.246933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be53fcb-c1c3-4ab0-8273-09dffe0f1651 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.247340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be53fcb-c1c3-4ab0-8273-09dffe0f1651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.247688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be53fcb-c1c3-4ab0-8273-09dffe0f1651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.249093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be53fcb-c1c3-4ab0-8273-09dffe0f1651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:10.250080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be53fcb-c1c3-4ab0-8273-09dffe0f1651 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.264261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1013/2036] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:10.265515 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9986740-a309-4025-8dba-690f41bf09cb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.277861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9986740-a309-4025-8dba-690f41bf09cb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:10.282960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ad2d7-73c4-425a-bc0e-16e4f12ff6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:10.283933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ad2d7-73c4-425a-bc0e-16e4f12ff6bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.284298 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ad2d7-73c4-425a-bc0e-16e4f12ff6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.284989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ad2d7-73c4-425a-bc0e-16e4f12ff6bf admin admin] PATH_INFO: `/v3/projects/7a1f8c8de2d847dfb4169e4aecab62c1/users/30b2bb2f3438474490318a7cd69b5154/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.287809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ad2d7-73c4-425a-bc0e-16e4f12ff6bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1f8c8de2d847dfb4169e4aecab62c1, user_id=30b2bb2f3438474490318a7cd69b5154, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:10.292155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ad2d7-73c4-425a-bc0e-16e4f12ff6bf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.306790 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1024/2037] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:10 2022] PUT /identity/v3/projects/7a1f8c8de2d847dfb4169e4aecab62c1/users/30b2bb2f3438474490318a7cd69b5154/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:10.317288 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dfee-0de4-4ae4-b5cd-63416743b7c5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.317834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dfee-0de4-4ae4-b5cd-63416743b7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.318164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dfee-0de4-4ae4-b5cd-63416743b7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.357052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6488dfee-0de4-4ae4-b5cd-63416743b7c5 None None] MFA Rules not processed for user `30b2bb2f3438474490318a7cd69b5154`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:10.358291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6488dfee-0de4-4ae4-b5cd-63416743b7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:10.426769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1014/2038] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:10.437587 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ad2d7-73c4-425a-bc0e-16e4f12ff6bf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:10.495744 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ad2d7-73c4-425a-bc0e-16e4f12ff6bf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:10.499398 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e9bb1-c212-46b9-8567-dac124c55c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:10.500009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e9bb1-c212-46b9-8567-dac124c55c11 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.500286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e9bb1-c212-46b9-8567-dac124c55c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.500556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e9bb1-c212-46b9-8567-dac124c55c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.541050 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3781c-d186-4984-b2c4-7cf562e2ccab None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:10.541449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3781c-d186-4984-b2c4-7cf562e2ccab None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:10.541768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3781c-d186-4984-b2c4-7cf562e2ccab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:10.562699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6ac3781c-d186-4984-b2c4-7cf562e2ccab None None] MFA Rules not processed for user `28831626fd594dc281d1ddd1aa3bab2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:10.563842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e9bb1-c212-46b9-8567-dac124c55c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:10.563960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ac3781c-d186-4984-b2c4-7cf562e2ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:10.565646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e9bb1-c212-46b9-8567-dac124c55c11 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:10.576173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1025/2039] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:10.633970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1015/2040] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:11.781873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:12.027806 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e9bb1-c212-46b9-8567-dac124c55c11 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:12.029844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-093e9bb1-c212-46b9-8567-dac124c55c11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:12.096356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e9bb1-c212-46b9-8567-dac124c55c11 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:12.100897 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:12.101593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.101911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.102185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] PATH_INFO: `/v3/users/2f402e7c835b40249bb8e47fb209aa8a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.103346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f402e7c835b40249bb8e47fb209aa8a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:12.105331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:12.113701 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:12.301224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f402e7c835b40249bb8e47fb209aa8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.302035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f402e7c835b40249bb8e47fb209aa8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.377402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f402e7c835b40249bb8e47fb209aa8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.377402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f402e7c835b40249bb8e47fb209aa8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.387371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f402e7c835b40249bb8e47fb209aa8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:12.401198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1026/2041] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:12 2022] DELETE /identity/v3/users/2f402e7c835b40249bb8e47fb209aa8a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:12.405832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397bb5f-162d-4b0b-b925-e275b2501897 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.406619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397bb5f-162d-4b0b-b925-e275b2501897 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.406957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397bb5f-162d-4b0b-b925-e275b2501897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.430289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5397bb5f-162d-4b0b-b925-e275b2501897 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:12.430289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5397bb5f-162d-4b0b-b925-e275b2501897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:12.504688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1016/2042] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:12.514650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:12.516050 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:12.581065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd5b1d-35ac-45f9-88f5-a446f01be638 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:12.585022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eaafe-3966-408d-a1c5-31f6e0f17384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:12.587196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eaafe-3966-408d-a1c5-31f6e0f17384 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:12.587196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eaafe-3966-408d-a1c5-31f6e0f17384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:12.587196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eaafe-3966-408d-a1c5-31f6e0f17384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:12.596537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4eaafe-3966-408d-a1c5-31f6e0f17384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:12.598016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4eaafe-3966-408d-a1c5-31f6e0f17384 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:12.608695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1027/2043] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:13.098947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397bb5f-162d-4b0b-b925-e275b2501897 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:13.100442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5397bb5f-162d-4b0b-b925-e275b2501897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:13.125529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397bb5f-162d-4b0b-b925-e275b2501897 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:13.126861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:13.127589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:13.128366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:13.128366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] PATH_INFO: `/v3/projects/a6ff1fe17af24407b85b82465e32cbfe` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.129348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ff1fe17af24407b85b82465e32cbfe)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:13.131373 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:13.532535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ff1fe17af24407b85b82465e32cbfe', 'request_id': 'req-5fa2f5cd-c812-4272-a3e3-4714e5ace202'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:13.545967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ff1fe17af24407b85b82465e32cbfe', 'request_id': 'req-5fa2f5cd-c812-4272-a3e3-4714e5ace202'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:13.552623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ff1fe17af24407b85b82465e32cbfe', 'request_id': 'req-5fa2f5cd-c812-4272-a3e3-4714e5ace202'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:13.679626 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] The token cache is being invalidate because project a6ff1fe17af24407b85b82465e32cbfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:13.680108 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:13.680804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:13.685325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1017/2044] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:13 2022] DELETE /identity/v3/projects/a6ff1fe17af24407b85b82465e32cbfe => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:13.686529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eaafe-3966-408d-a1c5-31f6e0f17384 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:13.698625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eaafe-3966-408d-a1c5-31f6e0f17384 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:13.769970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dfccb-57e5-410b-8d8c-0ab8b2441a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:13.770609 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dfccb-57e5-410b-8d8c-0ab8b2441a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:13.770886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dfccb-57e5-410b-8d8c-0ab8b2441a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:13.771153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dfccb-57e5-410b-8d8c-0ab8b2441a2d admin admin] PATH_INFO: `/v3/users/fd67c15081a24d149c1218a99d1a062a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:13.772487 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dfccb-57e5-410b-8d8c-0ab8b2441a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd67c15081a24d149c1218a99d1a062a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:13.775538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dfccb-57e5-410b-8d8c-0ab8b2441a2d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:13.940148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:14.043004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:14.085765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c43dfccb-57e5-410b-8d8c-0ab8b2441a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd67c15081a24d149c1218a99d1a062a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:14.086650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c43dfccb-57e5-410b-8d8c-0ab8b2441a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd67c15081a24d149c1218a99d1a062a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:14.187813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c43dfccb-57e5-410b-8d8c-0ab8b2441a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd67c15081a24d149c1218a99d1a062a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:14.188545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c43dfccb-57e5-410b-8d8c-0ab8b2441a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd67c15081a24d149c1218a99d1a062a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:14.203519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c43dfccb-57e5-410b-8d8c-0ab8b2441a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd67c15081a24d149c1218a99d1a062a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:14.218379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1028/2045] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:13 2022] DELETE /identity/v3/users/fd67c15081a24d149c1218a99d1a062a => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:14.774003 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:14.776307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:14.795356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2f5cd-c812-4272-a3e3-4714e5ace202 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:14.884978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:14.885707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:14.885986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:14.886841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] PATH_INFO: `/v3/projects/73112afa51404a8393fb65d45da07b32` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:14.888193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73112afa51404a8393fb65d45da07b32)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:14.890224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:15.047018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73112afa51404a8393fb65d45da07b32', 'request_id': 'req-f1864da7-b45f-4134-b59d-72925940b972'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.060441 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73112afa51404a8393fb65d45da07b32', 'request_id': 'req-f1864da7-b45f-4134-b59d-72925940b972'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.067198 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73112afa51404a8393fb65d45da07b32', 'request_id': 'req-f1864da7-b45f-4134-b59d-72925940b972'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.184326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] The token cache is being invalidate because project 73112afa51404a8393fb65d45da07b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:15.185551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.187543 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f1864da7-b45f-4134-b59d-72925940b972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.193631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1018/2046] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:14 2022] DELETE /identity/v3/projects/73112afa51404a8393fb65d45da07b32 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:15.199145 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b1e83-bb38-4d80-9c92-370fa14a1d01 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.200022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b1e83-bb38-4d80-9c92-370fa14a1d01 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.200531 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b1e83-bb38-4d80-9c92-370fa14a1d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.225012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f39b1e83-bb38-4d80-9c92-370fa14a1d01 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:15.234449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f39b1e83-bb38-4d80-9c92-370fa14a1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:15.360607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1029/2047] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:15.368702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99319527-4ec0-405d-9fa6-2d91ad7d275c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.369347 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99319527-4ec0-405d-9fa6-2d91ad7d275c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.369811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99319527-4ec0-405d-9fa6-2d91ad7d275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.389963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b1e83-bb38-4d80-9c92-370fa14a1d01 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:15.391527 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f39b1e83-bb38-4d80-9c92-370fa14a1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:15.394061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-99319527-4ec0-405d-9fa6-2d91ad7d275c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:15.395246 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-99319527-4ec0-405d-9fa6-2d91ad7d275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:15.405927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b1e83-bb38-4d80-9c92-370fa14a1d01 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:15.409036 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1019/2048] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:15.411169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1a9fc-3725-4b20-bed4-cb0e80047ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:15.412014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1a9fc-3725-4b20-bed4-cb0e80047ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.412398 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1a9fc-3725-4b20-bed4-cb0e80047ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.412775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1a9fc-3725-4b20-bed4-cb0e80047ae9 admin admin] PATH_INFO: `/v3/users/2ef870e8afb64c6dbd990259dea704f9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.414702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1a9fc-3725-4b20-bed4-cb0e80047ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef870e8afb64c6dbd990259dea704f9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:15.415242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99319527-4ec0-405d-9fa6-2d91ad7d275c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:15.417744 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1a9fc-3725-4b20-bed4-cb0e80047ae9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:15.425880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99319527-4ec0-405d-9fa6-2d91ad7d275c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:15.431303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2644a34-d03b-4252-bd3e-1cc40bf102cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:15.432146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2644a34-d03b-4252-bd3e-1cc40bf102cd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.432557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2644a34-d03b-4252-bd3e-1cc40bf102cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.432779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2644a34-d03b-4252-bd3e-1cc40bf102cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.433769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2644a34-d03b-4252-bd3e-1cc40bf102cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:15.434073 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2644a34-d03b-4252-bd3e-1cc40bf102cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:15.435916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2644a34-d03b-4252-bd3e-1cc40bf102cd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:15.456214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1020/2049] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:15.457208 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2644a34-d03b-4252-bd3e-1cc40bf102cd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:15.472915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2644a34-d03b-4252-bd3e-1cc40bf102cd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:15.479717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2e864-dc20-43d2-89e1-3a28b71699cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:15.480337 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2e864-dc20-43d2-89e1-3a28b71699cd admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.486495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2e864-dc20-43d2-89e1-3a28b71699cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.486495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2e864-dc20-43d2-89e1-3a28b71699cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.486495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2e864-dc20-43d2-89e1-3a28b71699cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:15.486495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2e864-dc20-43d2-89e1-3a28b71699cd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:15.582887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1021/2050] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:15 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:15.583905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2e864-dc20-43d2-89e1-3a28b71699cd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:15.641413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-49b1a9fc-3725-4b20-bed4-cb0e80047ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef870e8afb64c6dbd990259dea704f9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.644191 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-49b1a9fc-3725-4b20-bed4-cb0e80047ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef870e8afb64c6dbd990259dea704f9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.687665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2e864-dc20-43d2-89e1-3a28b71699cd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:15.693010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33570184-2e10-4ae3-8349-75d9e02ddfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:15.695817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33570184-2e10-4ae3-8349-75d9e02ddfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.695817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33570184-2e10-4ae3-8349-75d9e02ddfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.695817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33570184-2e10-4ae3-8349-75d9e02ddfb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.695817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33570184-2e10-4ae3-8349-75d9e02ddfb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:15.698045 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33570184-2e10-4ae3-8349-75d9e02ddfb2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:15.749607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-49b1a9fc-3725-4b20-bed4-cb0e80047ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef870e8afb64c6dbd990259dea704f9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.750491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-49b1a9fc-3725-4b20-bed4-cb0e80047ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef870e8afb64c6dbd990259dea704f9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.772348 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-49b1a9fc-3725-4b20-bed4-cb0e80047ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef870e8afb64c6dbd990259dea704f9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:15.788521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1030/2051] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:15 2022] DELETE /identity/v3/users/2ef870e8afb64c6dbd990259dea704f9 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:15.799484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ab49-0079-4839-8f9c-7cba62a3579c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.799828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ab49-0079-4839-8f9c-7cba62a3579c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.800058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ab49-0079-4839-8f9c-7cba62a3579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.801223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:15.808611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1022/2052] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:15 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:15.809857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33570184-2e10-4ae3-8349-75d9e02ddfb2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:15.812676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-33570184-2e10-4ae3-8349-75d9e02ddfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:15.830544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33570184-2e10-4ae3-8349-75d9e02ddfb2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:15.832155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-42d7ab49-0079-4839-8f9c-7cba62a3579c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:15.833509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-42d7ab49-0079-4839-8f9c-7cba62a3579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:15.912814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1031/2053] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:15.933354 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ab49-0079-4839-8f9c-7cba62a3579c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:15.936101 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-42d7ab49-0079-4839-8f9c-7cba62a3579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:15.944501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:15.959239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ffaaf-5d70-4e95-8218-496be261d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:15.960076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ffaaf-5d70-4e95-8218-496be261d00a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:15.960358 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ffaaf-5d70-4e95-8218-496be261d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:15.960686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ffaaf-5d70-4e95-8218-496be261d00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:15.961847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ffaaf-5d70-4e95-8218-496be261d00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:15.963469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ffaaf-5d70-4e95-8218-496be261d00a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:15.974908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1023/2054] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:15.984504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ffaaf-5d70-4e95-8218-496be261d00a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:15.995811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ffaaf-5d70-4e95-8218-496be261d00a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.001123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773261-591a-461a-b087-bf578b9407d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.001729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773261-591a-461a-b087-bf578b9407d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.002011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773261-591a-461a-b087-bf578b9407d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.002284 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773261-591a-461a-b087-bf578b9407d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.002982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8773261-591a-461a-b087-bf578b9407d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.005166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8773261-591a-461a-b087-bf578b9407d5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.009696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ab49-0079-4839-8f9c-7cba62a3579c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.016147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bbc60-7266-4d25-962b-36a51cff3a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.024926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bbc60-7266-4d25-962b-36a51cff3a54 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.024926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bbc60-7266-4d25-962b-36a51cff3a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.024926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bbc60-7266-4d25-962b-36a51cff3a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.025318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1024/2055] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:16.027768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bbc60-7266-4d25-962b-36a51cff3a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.028107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773261-591a-461a-b087-bf578b9407d5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:16.029159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bbc60-7266-4d25-962b-36a51cff3a54 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.041461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773261-591a-461a-b087-bf578b9407d5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.043659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1032/2056] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:16.047578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd70033-fc22-4d1b-b787-73701aa6ff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.048271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70033-fc22-4d1b-b787-73701aa6ff73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.048696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70033-fc22-4d1b-b787-73701aa6ff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.049032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70033-fc22-4d1b-b787-73701aa6ff73 admin admin] PATH_INFO: `/v3/projects/1284ae44c50a4e109184dac2041e050b/users/52b8687dcb5342dfb76c4074b352cbc0/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.067091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd70033-fc22-4d1b-b787-73701aa6ff73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1284ae44c50a4e109184dac2041e050b, user_id=52b8687dcb5342dfb76c4074b352cbc0, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.069848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd70033-fc22-4d1b-b787-73701aa6ff73 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.171600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1025/2057] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:16 2022] PUT /identity/v3/projects/1284ae44c50a4e109184dac2041e050b/users/52b8687dcb5342dfb76c4074b352cbc0/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:16.183271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c20f3-45b3-40ba-b44d-573afbe7df62 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.183552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c20f3-45b3-40ba-b44d-573afbe7df62 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.183825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c20f3-45b3-40ba-b44d-573afbe7df62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.212505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9b3c20f3-45b3-40ba-b44d-573afbe7df62 None None] MFA Rules not processed for user `52b8687dcb5342dfb76c4074b352cbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:16.213792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9b3c20f3-45b3-40ba-b44d-573afbe7df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:16.299191 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1033/2058] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:16.300790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd70033-fc22-4d1b-b787-73701aa6ff73 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:16.383683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd70033-fc22-4d1b-b787-73701aa6ff73 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.392952 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb849b4-9357-48dc-950b-5d55e6ee2d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.393722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb849b4-9357-48dc-950b-5d55e6ee2d71 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.394074 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb849b4-9357-48dc-950b-5d55e6ee2d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.394626 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb849b4-9357-48dc-950b-5d55e6ee2d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.395472 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb849b4-9357-48dc-950b-5d55e6ee2d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.397530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb849b4-9357-48dc-950b-5d55e6ee2d71 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.480387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c20f3-45b3-40ba-b44d-573afbe7df62 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:16.481826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9b3c20f3-45b3-40ba-b44d-573afbe7df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:16.521629 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c20f3-45b3-40ba-b44d-573afbe7df62 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.535537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.536216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.536491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.536761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] PATH_INFO: `/v3/projects/577dbbb10946405f88e8a56a0fa8c670` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.538392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577dbbb10946405f88e8a56a0fa8c670)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.540518 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.547684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1026/2059] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:16 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:16.552617 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb849b4-9357-48dc-950b-5d55e6ee2d71 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:16.632729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb849b4-9357-48dc-950b-5d55e6ee2d71 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.642623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73a1fe-41a6-43ef-9aa3-0bd2d4cf72da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.643389 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a1fe-41a6-43ef-9aa3-0bd2d4cf72da admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.644199 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a1fe-41a6-43ef-9aa3-0bd2d4cf72da admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.644199 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a1fe-41a6-43ef-9aa3-0bd2d4cf72da admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.644939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73a1fe-41a6-43ef-9aa3-0bd2d4cf72da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.647760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73a1fe-41a6-43ef-9aa3-0bd2d4cf72da admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.690150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577dbbb10946405f88e8a56a0fa8c670', 'request_id': 'req-92004e64-cbec-4038-879f-c6628650cfb6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.696987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577dbbb10946405f88e8a56a0fa8c670', 'request_id': 'req-92004e64-cbec-4038-879f-c6628650cfb6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.704889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577dbbb10946405f88e8a56a0fa8c670', 'request_id': 'req-92004e64-cbec-4038-879f-c6628650cfb6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.753185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1027/2060] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:16 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:16.754238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73a1fe-41a6-43ef-9aa3-0bd2d4cf72da admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:16.764166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73a1fe-41a6-43ef-9aa3-0bd2d4cf72da admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.782333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:16.782680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] The token cache is being invalidate because project 577dbbb10946405f88e8a56a0fa8c670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:16.782680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.782680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:16.782680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1034/2061] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:16 2022] DELETE /identity/v3/projects/577dbbb10946405f88e8a56a0fa8c670 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:16.785475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:16.786911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:16.829910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2349b85-c442-4089-abcc-fd2e24805354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.830564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349b85-c442-4089-abcc-fd2e24805354 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.830895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349b85-c442-4089-abcc-fd2e24805354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.831171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349b85-c442-4089-abcc-fd2e24805354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.832038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2349b85-c442-4089-abcc-fd2e24805354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.834240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2349b85-c442-4089-abcc-fd2e24805354 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.845419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1028/2062] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:16.849599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2349b85-c442-4089-abcc-fd2e24805354 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:16.852051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f2349b85-c442-4089-abcc-fd2e24805354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:16.866786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2349b85-c442-4089-abcc-fd2e24805354 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.873844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314ce5-ff81-47fa-ac92-73cf29bb14fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.874827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314ce5-ff81-47fa-ac92-73cf29bb14fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.875252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314ce5-ff81-47fa-ac92-73cf29bb14fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.875751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd314ce5-ff81-47fa-ac92-73cf29bb14fb admin admin] PATH_INFO: `/v3/projects/fd48151f88a24a80ae1344e0d0b8cdd3/users/90777cfde8b24d74aef634e93d191945/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.881324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:16.888738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92004e64-cbec-4038-879f-c6628650cfb6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:16.901026 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:16.902192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:16.902476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:16.902754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] PATH_INFO: `/v3/users/3bce1097824e4706b147accc77f64aa2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:16.904948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bce1097824e4706b147accc77f64aa2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.908694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.921169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd314ce5-ff81-47fa-ac92-73cf29bb14fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd48151f88a24a80ae1344e0d0b8cdd3, user_id=90777cfde8b24d74aef634e93d191945, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:16.923986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd314ce5-ff81-47fa-ac92-73cf29bb14fb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:16.973018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:17.002853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1029/2063] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:16 2022] PUT /identity/v3/projects/fd48151f88a24a80ae1344e0d0b8cdd3/users/90777cfde8b24d74aef634e93d191945/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:17.004080 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314ce5-ff81-47fa-ac92-73cf29bb14fb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:17.194262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd314ce5-ff81-47fa-ac92-73cf29bb14fb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:17.198697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bce1097824e4706b147accc77f64aa2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:17.200015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bce1097824e4706b147accc77f64aa2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:17.213957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e38457-1140-477c-96f3-751591692df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:17.213957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e38457-1140-477c-96f3-751591692df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:17.213957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e38457-1140-477c-96f3-751591692df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:17.213957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e38457-1140-477c-96f3-751591692df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:17.214482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e38457-1140-477c-96f3-751591692df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:17.214482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e38457-1140-477c-96f3-751591692df0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:17.228668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1030/2064] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:17.229834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e38457-1140-477c-96f3-751591692df0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:17.233684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-35e38457-1140-477c-96f3-751591692df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:17.286750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bce1097824e4706b147accc77f64aa2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:17.287291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bce1097824e4706b147accc77f64aa2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:17.314816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e38457-1140-477c-96f3-751591692df0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:17.319432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c79e82-c410-413d-9c31-c12bf64ebcaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:17.320826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c79e82-c410-413d-9c31-c12bf64ebcaf service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:17.321260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c79e82-c410-413d-9c31-c12bf64ebcaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:17.321580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c79e82-c410-413d-9c31-c12bf64ebcaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:17.323744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-33c79e82-c410-413d-9c31-c12bf64ebcaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:17.325860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bce1097824e4706b147accc77f64aa2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:17.349001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1035/2065] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:16 2022] DELETE /identity/v3/users/3bce1097824e4706b147accc77f64aa2 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:17.352595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:17.354055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:17.412434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c79e82-c410-413d-9c31-c12bf64ebcaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:17.415538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c79e82-c410-413d-9c31-c12bf64ebcaf service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:17.430434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1031/2066] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:17.441937 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9326b1-44b8-4c4f-8cab-bcc80fde772f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:17.448716 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114372d-9282-42a4-855e-97bb709e48b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:17.451305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114372d-9282-42a4-855e-97bb709e48b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:17.451305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114372d-9282-42a4-855e-97bb709e48b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:17.452607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114372d-9282-42a4-855e-97bb709e48b1 admin admin] PATH_INFO: `/v3/projects/fd48151f88a24a80ae1344e0d0b8cdd3/users/90777cfde8b24d74aef634e93d191945/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:17.452873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:17.455905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114372d-9282-42a4-855e-97bb709e48b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd48151f88a24a80ae1344e0d0b8cdd3, user_id=90777cfde8b24d74aef634e93d191945, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:17.459762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114372d-9282-42a4-855e-97bb709e48b1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:17.472576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1036/2067] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:17 2022] PUT /identity/v3/projects/fd48151f88a24a80ae1344e0d0b8cdd3/users/90777cfde8b24d74aef634e93d191945/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:17.484992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff33b22-8e73-46fd-9cca-72b925e6a1f2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:17.485500 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff33b22-8e73-46fd-9cca-72b925e6a1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:17.485879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff33b22-8e73-46fd-9cca-72b925e6a1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:17.537966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cff33b22-8e73-46fd-9cca-72b925e6a1f2 None None] MFA Rules not processed for user `90777cfde8b24d74aef634e93d191945`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:17.540664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cff33b22-8e73-46fd-9cca-72b925e6a1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:17.696140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1032/2068] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:17.704513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114372d-9282-42a4-855e-97bb709e48b1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:17.718080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5114372d-9282-42a4-855e-97bb709e48b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:17.838662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114372d-9282-42a4-855e-97bb709e48b1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:17.842881 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370060f-3afd-4e11-8fc0-f342f911dcc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:17.843446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370060f-3afd-4e11-8fc0-f342f911dcc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:17.843728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370060f-3afd-4e11-8fc0-f342f911dcc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:17.844001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370060f-3afd-4e11-8fc0-f342f911dcc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:17.845815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3370060f-3afd-4e11-8fc0-f342f911dcc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:17.947130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff33b22-8e73-46fd-9cca-72b925e6a1f2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:17.948706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cff33b22-8e73-46fd-9cca-72b925e6a1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:17.963600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370060f-3afd-4e11-8fc0-f342f911dcc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:17.965491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370060f-3afd-4e11-8fc0-f342f911dcc0 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:17.989736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1037/2069] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:18.049838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff33b22-8e73-46fd-9cca-72b925e6a1f2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:18.057508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:18.058197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.058522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.058946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] PATH_INFO: `/v3/users/a3c7e6f82acd45488412439dccb933f2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.060334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c7e6f82acd45488412439dccb933f2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:18.063224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:18.115866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370060f-3afd-4e11-8fc0-f342f911dcc0 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:18.118640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3370060f-3afd-4e11-8fc0-f342f911dcc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:18.132703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370060f-3afd-4e11-8fc0-f342f911dcc0 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:18.138550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288d441-29d3-454d-9695-272934364efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:18.139213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288d441-29d3-454d-9695-272934364efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.144474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288d441-29d3-454d-9695-272934364efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.144474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288d441-29d3-454d-9695-272934364efd admin admin] PATH_INFO: `/v3/projects/c2d534772eb94d6a8923b94717534ac5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.144474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288d441-29d3-454d-9695-272934364efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d534772eb94d6a8923b94717534ac5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:18.144474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288d441-29d3-454d-9695-272934364efd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:18.166871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:18.288173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c7e6f82acd45488412439dccb933f2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.295134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0288d441-29d3-454d-9695-272934364efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d534772eb94d6a8923b94717534ac5', 'request_id': 'req-0288d441-29d3-454d-9695-272934364efd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.313894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0288d441-29d3-454d-9695-272934364efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d534772eb94d6a8923b94717534ac5', 'request_id': 'req-0288d441-29d3-454d-9695-272934364efd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.320139 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0288d441-29d3-454d-9695-272934364efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d534772eb94d6a8923b94717534ac5', 'request_id': 'req-0288d441-29d3-454d-9695-272934364efd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.451908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c7e6f82acd45488412439dccb933f2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.452664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c7e6f82acd45488412439dccb933f2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.453469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c7e6f82acd45488412439dccb933f2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.468870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c7e6f82acd45488412439dccb933f2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.508669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1033/2070] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:17 2022] DELETE /identity/v3/users/a3c7e6f82acd45488412439dccb933f2 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:18.544852 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0288d441-29d3-454d-9695-272934364efd admin admin] The token cache is being invalidate because project c2d534772eb94d6a8923b94717534ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:18.545333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0288d441-29d3-454d-9695-272934364efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.546216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0288d441-29d3-454d-9695-272934364efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.548423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1038/2071] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:18 2022] DELETE /identity/v3/projects/c2d534772eb94d6a8923b94717534ac5 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:18.552138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:18.553837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:18.649394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601c507-a07f-4ed7-8566-97d62ba4ff12 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:18.654988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bcfcf-5ee8-4ce7-ab02-e6813d7d240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:18.655698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bcfcf-5ee8-4ce7-ab02-e6813d7d240b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.655979 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bcfcf-5ee8-4ce7-ab02-e6813d7d240b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.656254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bcfcf-5ee8-4ce7-ab02-e6813d7d240b admin admin] PATH_INFO: `/v3/users/72823e9cf7a345f8a79e3b3d43c10f4f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.657513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bcfcf-5ee8-4ce7-ab02-e6813d7d240b admin admin] RBAC: Authorizing `identity:delete_user(user_id=72823e9cf7a345f8a79e3b3d43c10f4f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:18.659734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bcfcf-5ee8-4ce7-ab02-e6813d7d240b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:18.779491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288d441-29d3-454d-9695-272934364efd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:18.781432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0288d441-29d3-454d-9695-272934364efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:18.829679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f49bcfcf-5ee8-4ce7-ab02-e6813d7d240b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72823e9cf7a345f8a79e3b3d43c10f4f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.861775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288d441-29d3-454d-9695-272934364efd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:18.866905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:18.867753 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:18.868043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:18.868323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] PATH_INFO: `/v3/projects/2df70afd2478469d8ae2fdad0d84de6b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:18.869529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df70afd2478469d8ae2fdad0d84de6b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:18.871456 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:18.891326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f49bcfcf-5ee8-4ce7-ab02-e6813d7d240b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72823e9cf7a345f8a79e3b3d43c10f4f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.891984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f49bcfcf-5ee8-4ce7-ab02-e6813d7d240b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72823e9cf7a345f8a79e3b3d43c10f4f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.892619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f49bcfcf-5ee8-4ce7-ab02-e6813d7d240b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72823e9cf7a345f8a79e3b3d43c10f4f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.908390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f49bcfcf-5ee8-4ce7-ab02-e6813d7d240b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72823e9cf7a345f8a79e3b3d43c10f4f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:18.922839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1034/2072] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:18 2022] DELETE /identity/v3/users/72823e9cf7a345f8a79e3b3d43c10f4f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:19.003733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df70afd2478469d8ae2fdad0d84de6b', 'request_id': 'req-f41fb793-670c-4e15-864c-01b02ae99763'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.012705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df70afd2478469d8ae2fdad0d84de6b', 'request_id': 'req-f41fb793-670c-4e15-864c-01b02ae99763'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.020875 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df70afd2478469d8ae2fdad0d84de6b', 'request_id': 'req-f41fb793-670c-4e15-864c-01b02ae99763'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.051611 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:19.086246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] The token cache is being invalidate because project 2df70afd2478469d8ae2fdad0d84de6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:19.086543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.087507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f41fb793-670c-4e15-864c-01b02ae99763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.089426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1039/2073] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:18 2022] DELETE /identity/v3/projects/2df70afd2478469d8ae2fdad0d84de6b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:19.095307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abf475-1041-4c1b-95e1-8be412efb600 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.095899 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abf475-1041-4c1b-95e1-8be412efb600 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.095899 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abf475-1041-4c1b-95e1-8be412efb600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.120476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d5abf475-1041-4c1b-95e1-8be412efb600 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:19.121843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d5abf475-1041-4c1b-95e1-8be412efb600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:19.200306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1035/2074] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:19.208205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c37f73-a275-463d-ab41-c9894dd5c0b6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.208518 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c37f73-a275-463d-ab41-c9894dd5c0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.208798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c37f73-a275-463d-ab41-c9894dd5c0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.231196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f8c37f73-a275-463d-ab41-c9894dd5c0b6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:19.232402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f8c37f73-a275-463d-ab41-c9894dd5c0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:19.240845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1040/2075] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:19.245723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abf475-1041-4c1b-95e1-8be412efb600 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.255449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abf475-1041-4c1b-95e1-8be412efb600 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.261146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421498d-628b-46b9-8363-2fe104044fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.261829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421498d-628b-46b9-8363-2fe104044fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.262156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421498d-628b-46b9-8363-2fe104044fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.262420 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421498d-628b-46b9-8363-2fe104044fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.263123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421498d-628b-46b9-8363-2fe104044fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:19.263425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421498d-628b-46b9-8363-2fe104044fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.265081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421498d-628b-46b9-8363-2fe104044fb0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:19.277829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1036/2076] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:39:19.281600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c37f73-a275-463d-ab41-c9894dd5c0b6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.291525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c37f73-a275-463d-ab41-c9894dd5c0b6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.296189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e4076-ba7c-4e30-9ef2-a813f92ae6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.296793 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e4076-ba7c-4e30-9ef2-a813f92ae6be admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.299344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e4076-ba7c-4e30-9ef2-a813f92ae6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.299344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e4076-ba7c-4e30-9ef2-a813f92ae6be admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.299344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e4076-ba7c-4e30-9ef2-a813f92ae6be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.299891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e4076-ba7c-4e30-9ef2-a813f92ae6be admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:19.349117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421498d-628b-46b9-8363-2fe104044fb0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.350962 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0421498d-628b-46b9-8363-2fe104044fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:19.364356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421498d-628b-46b9-8363-2fe104044fb0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.375919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.375919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.375919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.375919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] PATH_INFO: `/v3/projects/e66a11d10026421082accc506d7c9853` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.376237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1041/2077] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:19.378258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66a11d10026421082accc506d7c9853)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.378667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e4076-ba7c-4e30-9ef2-a813f92ae6be admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.380212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:19.447145 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e4076-ba7c-4e30-9ef2-a813f92ae6be admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.452128 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0768f71-436e-498c-91e8-c041819a856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.452746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0768f71-436e-498c-91e8-c041819a856a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.453021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0768f71-436e-498c-91e8-c041819a856a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.453321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0768f71-436e-498c-91e8-c041819a856a admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.454000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0768f71-436e-498c-91e8-c041819a856a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.455987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0768f71-436e-498c-91e8-c041819a856a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:19.495969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66a11d10026421082accc506d7c9853', 'request_id': 'req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.503066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66a11d10026421082accc506d7c9853', 'request_id': 'req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.515205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66a11d10026421082accc506d7c9853', 'request_id': 'req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.555862 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1042/2078] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:19.559686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0768f71-436e-498c-91e8-c041819a856a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.569036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0768f71-436e-498c-91e8-c041819a856a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.616738 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] The token cache is being invalidate because project e66a11d10026421082accc506d7c9853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:19.617197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.617972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0dbc7cc9-fcb5-402d-b528-7ad10ad612b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:19.623565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1037/2079] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:19 2022] DELETE /identity/v3/projects/e66a11d10026421082accc506d7c9853 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:19.626038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e4484-be1f-4dbf-b357-ce517d5a4007 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.626265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e4484-be1f-4dbf-b357-ce517d5a4007 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.626538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e4484-be1f-4dbf-b357-ce517d5a4007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.626649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a67ea-c8bb-4e8d-bc97-d0fc5999bc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.627224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a67ea-c8bb-4e8d-bc97-d0fc5999bc07 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.627497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a67ea-c8bb-4e8d-bc97-d0fc5999bc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.627767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a67ea-c8bb-4e8d-bc97-d0fc5999bc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.628458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a67ea-c8bb-4e8d-bc97-d0fc5999bc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.630206 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a67ea-c8bb-4e8d-bc97-d0fc5999bc07 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:19.644040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1043/2080] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:19.650056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a67ea-c8bb-4e8d-bc97-d0fc5999bc07 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.650204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cf3e4484-be1f-4dbf-b357-ce517d5a4007 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:19.651320 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cf3e4484-be1f-4dbf-b357-ce517d5a4007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:19.651675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e87a67ea-c8bb-4e8d-bc97-d0fc5999bc07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:19.659735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1038/2081] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:19.665566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a67ea-c8bb-4e8d-bc97-d0fc5999bc07 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.670534 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342bf24-0040-43dc-88fb-0f5c5941b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.670755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340321c4-7179-4c5d-a452-0344b60c4420 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.671156 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342bf24-0040-43dc-88fb-0f5c5941b995 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.671275 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340321c4-7179-4c5d-a452-0344b60c4420 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.671441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342bf24-0040-43dc-88fb-0f5c5941b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.671687 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340321c4-7179-4c5d-a452-0344b60c4420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.673240 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342bf24-0040-43dc-88fb-0f5c5941b995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.673936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342bf24-0040-43dc-88fb-0f5c5941b995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.675617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342bf24-0040-43dc-88fb-0f5c5941b995 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:19.681598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:19.690487 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1044/2082] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:19.692443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342bf24-0040-43dc-88fb-0f5c5941b995 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.694448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-340321c4-7179-4c5d-a452-0344b60c4420 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:19.696527 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-340321c4-7179-4c5d-a452-0344b60c4420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:19.704585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342bf24-0040-43dc-88fb-0f5c5941b995 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.705264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1039/2083] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:19.709452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340321c4-7179-4c5d-a452-0344b60c4420 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.711399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a0e3d-3632-47c2-b5d8-a6766563c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.712077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a0e3d-3632-47c2-b5d8-a6766563c641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.712407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a0e3d-3632-47c2-b5d8-a6766563c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.712694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a0e3d-3632-47c2-b5d8-a6766563c641 admin admin] PATH_INFO: `/v3/projects/8348eb44d8744da5be67762750ff1342/users/1d26b75ec57041c19d1bcd313f13d49f/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.720563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340321c4-7179-4c5d-a452-0344b60c4420 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.725751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141257d7-a8a7-4628-8fef-169eb5221b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.728944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141257d7-a8a7-4628-8fef-169eb5221b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.728944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141257d7-a8a7-4628-8fef-169eb5221b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.728944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141257d7-a8a7-4628-8fef-169eb5221b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.728944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141257d7-a8a7-4628-8fef-169eb5221b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:19.728944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141257d7-a8a7-4628-8fef-169eb5221b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.729948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141257d7-a8a7-4628-8fef-169eb5221b86 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:19.736795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a0e3d-3632-47c2-b5d8-a6766563c641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8348eb44d8744da5be67762750ff1342, user_id=1d26b75ec57041c19d1bcd313f13d49f, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.739985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a0e3d-3632-47c2-b5d8-a6766563c641 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:19.743694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1040/2084] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:39:19.747278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141257d7-a8a7-4628-8fef-169eb5221b86 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.758596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141257d7-a8a7-4628-8fef-169eb5221b86 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.763580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cb48b-6158-4f36-b68d-e1aecd48abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.764343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cb48b-6158-4f36-b68d-e1aecd48abc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.764739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cb48b-6158-4f36-b68d-e1aecd48abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.765017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cb48b-6158-4f36-b68d-e1aecd48abc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.765885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cb48b-6158-4f36-b68d-e1aecd48abc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.768279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cb48b-6158-4f36-b68d-e1aecd48abc2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:19.811087 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1045/2085] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:19 2022] PUT /identity/v3/projects/8348eb44d8744da5be67762750ff1342/users/1d26b75ec57041c19d1bcd313f13d49f/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:19.821946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e8618-d00b-4bc9-b4b1-35d20c22b8d0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.822229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e8618-d00b-4bc9-b4b1-35d20c22b8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.822695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e8618-d00b-4bc9-b4b1-35d20c22b8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.855746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ad4e8618-d00b-4bc9-b4b1-35d20c22b8d0 None None] MFA Rules not processed for user `1d26b75ec57041c19d1bcd313f13d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:19.857594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ad4e8618-d00b-4bc9-b4b1-35d20c22b8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:19.881666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1041/2086] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:19.883692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cb48b-6158-4f36-b68d-e1aecd48abc2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.927522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1046/2087] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:19.941902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e8618-d00b-4bc9-b4b1-35d20c22b8d0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:19.947658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ad4e8618-d00b-4bc9-b4b1-35d20c22b8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:19.961641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cb48b-6158-4f36-b68d-e1aecd48abc2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:19.967061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f2255-d4aa-4bdb-925e-4141f7c5d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:19.967922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f2255-d4aa-4bdb-925e-4141f7c5d1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:19.968435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f2255-d4aa-4bdb-925e-4141f7c5d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:19.968945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f2255-d4aa-4bdb-925e-4141f7c5d1f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:19.969676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f2255-d4aa-4bdb-925e-4141f7c5d1f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:19.971851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f2255-d4aa-4bdb-925e-4141f7c5d1f7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.043800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e8618-d00b-4bc9-b4b1-35d20c22b8d0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:20.084179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1042/2088] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:19 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:20.088520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f2255-d4aa-4bdb-925e-4141f7c5d1f7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:20.098058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f2255-d4aa-4bdb-925e-4141f7c5d1f7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:20.103012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d1e95-d8b5-4a61-94e8-d57eb3eae332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:20.103620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d1e95-d8b5-4a61-94e8-d57eb3eae332 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.103907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d1e95-d8b5-4a61-94e8-d57eb3eae332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.104177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d1e95-d8b5-4a61-94e8-d57eb3eae332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.104873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d1e95-d8b5-4a61-94e8-d57eb3eae332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:20.106747 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d1e95-d8b5-4a61-94e8-d57eb3eae332 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.113841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82fe78-c687-4b80-825f-04be44fad5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:20.114476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82fe78-c687-4b80-825f-04be44fad5b7 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.115903 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82fe78-c687-4b80-825f-04be44fad5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.115903 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82fe78-c687-4b80-825f-04be44fad5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.119170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1043/2089] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:20.123010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d1e95-d8b5-4a61-94e8-d57eb3eae332 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:20.136030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d1e95-d8b5-4a61-94e8-d57eb3eae332 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:20.140884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aadedd-1025-4e9d-8c64-afe72c6321fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:20.141536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aadedd-1025-4e9d-8c64-afe72c6321fb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.144539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aadedd-1025-4e9d-8c64-afe72c6321fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.144539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aadedd-1025-4e9d-8c64-afe72c6321fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.144539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aadedd-1025-4e9d-8c64-afe72c6321fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:20.144539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aadedd-1025-4e9d-8c64-afe72c6321fb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.158323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1044/2090] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:20.159597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aadedd-1025-4e9d-8c64-afe72c6321fb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:20.176414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aadedd-1025-4e9d-8c64-afe72c6321fb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:20.181794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82fe78-c687-4b80-825f-04be44fad5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:20.182195 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b27c1-09ff-4008-b8aa-6dc63e2e8409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:20.182869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b27c1-09ff-4008-b8aa-6dc63e2e8409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.183150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b27c1-09ff-4008-b8aa-6dc63e2e8409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.183379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82fe78-c687-4b80-825f-04be44fad5b7 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.183492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b27c1-09ff-4008-b8aa-6dc63e2e8409 admin admin] PATH_INFO: `/v3/projects/94cab9a807b6465e842b7fef844b2a50/users/5290a9196a8a48c5bfbefc108c58fffb/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.193183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1047/2091] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:20.202684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b27c1-09ff-4008-b8aa-6dc63e2e8409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94cab9a807b6465e842b7fef844b2a50, user_id=5290a9196a8a48c5bfbefc108c58fffb, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:20.204322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b27c1-09ff-4008-b8aa-6dc63e2e8409 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.337119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1045/2092] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:20 2022] PUT /identity/v3/projects/94cab9a807b6465e842b7fef844b2a50/users/5290a9196a8a48c5bfbefc108c58fffb/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:20.342387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d4a02-3d30-4d47-a98c-69d04b682196 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.342898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d4a02-3d30-4d47-a98c-69d04b682196 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.342988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d4a02-3d30-4d47-a98c-69d04b682196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.362532 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-af0d4a02-3d30-4d47-a98c-69d04b682196 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:20.363726 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-af0d4a02-3d30-4d47-a98c-69d04b682196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:20.369111 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:20.429835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1048/2093] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:20.439294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b27c1-09ff-4008-b8aa-6dc63e2e8409 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:20.441000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b96b27c1-09ff-4008-b8aa-6dc63e2e8409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:20.504192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b27c1-09ff-4008-b8aa-6dc63e2e8409 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:20.504575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a3bde-f2c0-4352-b957-071b8858682d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:20.505245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a3bde-f2c0-4352-b957-071b8858682d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:20.505536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a3bde-f2c0-4352-b957-071b8858682d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:20.506388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a3bde-f2c0-4352-b957-071b8858682d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:20.516937 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a3bde-f2c0-4352-b957-071b8858682d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:20.518447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a3bde-f2c0-4352-b957-071b8858682d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:20.530478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1046/2094] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:21.240401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:21.561206 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:21.577069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d4a02-3d30-4d47-a98c-69d04b682196 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:21.578622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-af0d4a02-3d30-4d47-a98c-69d04b682196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:21.637656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d4a02-3d30-4d47-a98c-69d04b682196 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:21.641517 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c4e8e-0da8-4c77-9e29-48995a670bca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:21.642196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c4e8e-0da8-4c77-9e29-48995a670bca service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:21.642428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c4e8e-0da8-4c77-9e29-48995a670bca service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:21.642702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c4e8e-0da8-4c77-9e29-48995a670bca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:21.644593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc1c4e8e-0da8-4c77-9e29-48995a670bca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:21.713904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c4e8e-0da8-4c77-9e29-48995a670bca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:21.715353 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c4e8e-0da8-4c77-9e29-48995a670bca service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:21.724966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1049/2095] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:23.388851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:23.537671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:23.765629 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a3bde-f2c0-4352-b957-071b8858682d service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:23.781492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a3bde-f2c0-4352-b957-071b8858682d service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:23.788629 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584f491-87f9-493a-a504-a890dbb78579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:23.789400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584f491-87f9-493a-a504-a890dbb78579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:23.792905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584f491-87f9-493a-a504-a890dbb78579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:23.792905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584f491-87f9-493a-a504-a890dbb78579 admin admin] PATH_INFO: `/v3/users/1d26b75ec57041c19d1bcd313f13d49f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:23.792905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584f491-87f9-493a-a504-a890dbb78579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d26b75ec57041c19d1bcd313f13d49f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:23.795109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584f491-87f9-493a-a504-a890dbb78579 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:24.021149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0584f491-87f9-493a-a504-a890dbb78579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d26b75ec57041c19d1bcd313f13d49f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.062108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c4e8e-0da8-4c77-9e29-48995a670bca service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:24.063590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc1c4e8e-0da8-4c77-9e29-48995a670bca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:24.080039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0584f491-87f9-493a-a504-a890dbb78579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d26b75ec57041c19d1bcd313f13d49f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.080678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0584f491-87f9-493a-a504-a890dbb78579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d26b75ec57041c19d1bcd313f13d49f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.081355 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0584f491-87f9-493a-a504-a890dbb78579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d26b75ec57041c19d1bcd313f13d49f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.086816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c4e8e-0da8-4c77-9e29-48995a670bca service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:24.091938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:24.092872 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:24.093434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:24.093940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] PATH_INFO: `/v3/users/f6e2bc76741c461a98f4d130ad60ec8d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:24.095566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e2bc76741c461a98f4d130ad60ec8d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:24.097830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:24.101395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0584f491-87f9-493a-a504-a890dbb78579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d26b75ec57041c19d1bcd313f13d49f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.144987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1047/2096] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:23 2022] DELETE /identity/v3/users/1d26b75ec57041c19d1bcd313f13d49f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:24.153076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7573-c856-409c-b776-c8c876854bbe None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:24.153393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7573-c856-409c-b776-c8c876854bbe None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:24.153675 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7573-c856-409c-b776-c8c876854bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:24.192975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8a6b7573-c856-409c-b776-c8c876854bbe None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:24.194261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a6b7573-c856-409c-b776-c8c876854bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:24.262069 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1048/2097] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:24.272235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7573-c856-409c-b776-c8c876854bbe None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:24.274004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a6b7573-c856-409c-b776-c8c876854bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:24.290976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e2bc76741c461a98f4d130ad60ec8d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.291682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e2bc76741c461a98f4d130ad60ec8d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.341414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7573-c856-409c-b776-c8c876854bbe None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:24.352266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c235c3e-6ad2-46dc-b631-a158f63d1dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:24.353646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c235c3e-6ad2-46dc-b631-a158f63d1dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:24.353942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c235c3e-6ad2-46dc-b631-a158f63d1dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:24.354397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c235c3e-6ad2-46dc-b631-a158f63d1dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:24.368496 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c235c3e-6ad2-46dc-b631-a158f63d1dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:24.370630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c235c3e-6ad2-46dc-b631-a158f63d1dd8 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:24.378096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e2bc76741c461a98f4d130ad60ec8d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.379272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e2bc76741c461a98f4d130ad60ec8d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.388832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1049/2098] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:24.393631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e2bc76741c461a98f4d130ad60ec8d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:24.407019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1050/2099] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:24 2022] DELETE /identity/v3/users/f6e2bc76741c461a98f4d130ad60ec8d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:24.411715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d010e9-57e0-47b2-a288-7f01e258b50e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:24.412091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d010e9-57e0-47b2-a288-7f01e258b50e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:24.417522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d010e9-57e0-47b2-a288-7f01e258b50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:24.435238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-31d010e9-57e0-47b2-a288-7f01e258b50e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:24.436466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-31d010e9-57e0-47b2-a288-7f01e258b50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:24.529575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1050/2100] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:24.540323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:24.542387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:24.627996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b0f5-94d7-4df8-8a30-fde9649ff230 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:24.633953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56272e-c6ea-43cc-a541-389cd6c8e908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:24.634836 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56272e-c6ea-43cc-a541-389cd6c8e908 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:24.635305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56272e-c6ea-43cc-a541-389cd6c8e908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:24.636061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56272e-c6ea-43cc-a541-389cd6c8e908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:24.659741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56272e-c6ea-43cc-a541-389cd6c8e908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:24.659741 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56272e-c6ea-43cc-a541-389cd6c8e908 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:24.667066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1051/2101] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:24.861807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:24.988963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d010e9-57e0-47b2-a288-7f01e258b50e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:24.990833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-31d010e9-57e0-47b2-a288-7f01e258b50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.006289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d010e9-57e0-47b2-a288-7f01e258b50e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.009505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:25.026554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.027455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.027886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.028461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] PATH_INFO: `/v3/projects/8348eb44d8744da5be67762750ff1342` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.030261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8348eb44d8744da5be67762750ff1342)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.032914 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.188066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8348eb44d8744da5be67762750ff1342', 'request_id': 'req-6243f66d-6ebe-4321-8951-3f4728e396b8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.202577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8348eb44d8744da5be67762750ff1342', 'request_id': 'req-6243f66d-6ebe-4321-8951-3f4728e396b8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.220136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8348eb44d8744da5be67762750ff1342', 'request_id': 'req-6243f66d-6ebe-4321-8951-3f4728e396b8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.309737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] The token cache is being invalidate because project 8348eb44d8744da5be67762750ff1342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:25.310224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.310993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6243f66d-6ebe-4321-8951-3f4728e396b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.313068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1051/2102] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:24 2022] DELETE /identity/v3/projects/8348eb44d8744da5be67762750ff1342 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:25.317726 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a335b7-618d-487c-9876-414cfee2da66 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.318176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a335b7-618d-487c-9876-414cfee2da66 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.318454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a335b7-618d-487c-9876-414cfee2da66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.358561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e9a335b7-618d-487c-9876-414cfee2da66 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:25.360245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e9a335b7-618d-487c-9876-414cfee2da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.434462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1052/2103] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:25.447286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a0e91-273c-4e74-b2ec-75760feed6ce None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.452633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a0e91-273c-4e74-b2ec-75760feed6ce None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.452633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a0e91-273c-4e74-b2ec-75760feed6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.478119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a335b7-618d-487c-9876-414cfee2da66 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.483030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e9a335b7-618d-487c-9876-414cfee2da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.501763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0b6a0e91-273c-4e74-b2ec-75760feed6ce None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:25.505720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0b6a0e91-273c-4e74-b2ec-75760feed6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.510574 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a335b7-618d-487c-9876-414cfee2da66 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.518565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.520128 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.520659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.521754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] PATH_INFO: `/v3/projects/e93de823c5b44b72bfe5c6a06a4b7065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.521918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1052/2104] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:25.525922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93de823c5b44b72bfe5c6a06a4b7065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.526787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a0e91-273c-4e74-b2ec-75760feed6ce None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.528282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.545392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a0e91-273c-4e74-b2ec-75760feed6ce None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.547573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266603a1-c06a-4663-a2a7-99df77b7a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.548586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266603a1-c06a-4663-a2a7-99df77b7a429 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.548871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266603a1-c06a-4663-a2a7-99df77b7a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.549218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266603a1-c06a-4663-a2a7-99df77b7a429 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.550139 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266603a1-c06a-4663-a2a7-99df77b7a429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:25.550385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266603a1-c06a-4663-a2a7-99df77b7a429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.552070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266603a1-c06a-4663-a2a7-99df77b7a429 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.580564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1053/2105] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:25.584824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266603a1-c06a-4663-a2a7-99df77b7a429 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.604510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266603a1-c06a-4663-a2a7-99df77b7a429 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.613365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb490da-b43b-4fa9-bd46-e45ed3a473b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.614082 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb490da-b43b-4fa9-bd46-e45ed3a473b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.619559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb490da-b43b-4fa9-bd46-e45ed3a473b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.619559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb490da-b43b-4fa9-bd46-e45ed3a473b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.619559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb490da-b43b-4fa9-bd46-e45ed3a473b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.619559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb490da-b43b-4fa9-bd46-e45ed3a473b3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.655200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93de823c5b44b72bfe5c6a06a4b7065', 'request_id': 'req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.661658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93de823c5b44b72bfe5c6a06a4b7065', 'request_id': 'req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.668323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93de823c5b44b72bfe5c6a06a4b7065', 'request_id': 'req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.745639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1054/2106] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:25.747483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb490da-b43b-4fa9-bd46-e45ed3a473b3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.765567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] The token cache is being invalidate because project e93de823c5b44b72bfe5c6a06a4b7065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:25.766033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.767391 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:25.775412 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1053/2107] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:25 2022] DELETE /identity/v3/projects/e93de823c5b44b72bfe5c6a06a4b7065 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:25.792541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:25.797529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:25.903697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb490da-b43b-4fa9-bd46-e45ed3a473b3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.912907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45a4d1-b4f1-461d-96c0-011a4286aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.914142 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a4d1-b4f1-461d-96c0-011a4286aeae admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.914723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a4d1-b4f1-461d-96c0-011a4286aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.914723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a4d1-b4f1-461d-96c0-011a4286aeae admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.915333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45a4d1-b4f1-461d-96c0-011a4286aeae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.917330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45a4d1-b4f1-461d-96c0-011a4286aeae admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:25.941171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f54e1f-a1c6-4791-93a8-f8a5ce2e2415 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:25.951728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:25.952657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:25.953089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:25.953533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] PATH_INFO: `/v3/users/30b2bb2f3438474490318a7cd69b5154` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:25.954957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b2bb2f3438474490318a7cd69b5154)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:25.957711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.029824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1055/2108] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:25 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:26.033872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45a4d1-b4f1-461d-96c0-011a4286aeae admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.035967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8c45a4d1-b4f1-461d-96c0-011a4286aeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:26.049647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45a4d1-b4f1-461d-96c0-011a4286aeae admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.055414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1823830-0a38-4d00-a48c-5f58bd882180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.056090 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1823830-0a38-4d00-a48c-5f58bd882180 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.056525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1823830-0a38-4d00-a48c-5f58bd882180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.056797 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1823830-0a38-4d00-a48c-5f58bd882180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.057546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1823830-0a38-4d00-a48c-5f58bd882180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.059185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1823830-0a38-4d00-a48c-5f58bd882180 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.077278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1056/2109] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:26.081000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1823830-0a38-4d00-a48c-5f58bd882180 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.092909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1823830-0a38-4d00-a48c-5f58bd882180 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.101753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabd26e-f6d1-45eb-8f1b-d86369eb9453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.102384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd26e-f6d1-45eb-8f1b-d86369eb9453 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.102663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd26e-f6d1-45eb-8f1b-d86369eb9453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.102933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd26e-f6d1-45eb-8f1b-d86369eb9453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.103638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabd26e-f6d1-45eb-8f1b-d86369eb9453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.105289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabd26e-f6d1-45eb-8f1b-d86369eb9453 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.118891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1057/2110] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:26.122969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabd26e-f6d1-45eb-8f1b-d86369eb9453 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.137321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabd26e-f6d1-45eb-8f1b-d86369eb9453 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.143784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d54220-bbd0-49b6-87be-ec389f2c491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.144915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d54220-bbd0-49b6-87be-ec389f2c491f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.144915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d54220-bbd0-49b6-87be-ec389f2c491f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.145091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d54220-bbd0-49b6-87be-ec389f2c491f admin admin] PATH_INFO: `/v3/projects/9bb3eae65a6c41c3af9ec80f9ea983d6/users/69012c22491143229137d06b0920a8bc/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.166844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d54220-bbd0-49b6-87be-ec389f2c491f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb3eae65a6c41c3af9ec80f9ea983d6, user_id=69012c22491143229137d06b0920a8bc, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.166844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d54220-bbd0-49b6-87be-ec389f2c491f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.205846 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b2bb2f3438474490318a7cd69b5154'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:26.206554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b2bb2f3438474490318a7cd69b5154'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:26.218211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:26.289739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1058/2111] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:26 2022] PUT /identity/v3/projects/9bb3eae65a6c41c3af9ec80f9ea983d6/users/69012c22491143229137d06b0920a8bc/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:26.309348 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b2bb2f3438474490318a7cd69b5154'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:26.310020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b2bb2f3438474490318a7cd69b5154'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:26.314388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56efbf9-e957-40dd-93d3-17fb88fdafa5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.314700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56efbf9-e957-40dd-93d3-17fb88fdafa5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.315376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56efbf9-e957-40dd-93d3-17fb88fdafa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.326272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b2bb2f3438474490318a7cd69b5154'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:26.339877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1054/2112] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:25 2022] DELETE /identity/v3/users/30b2bb2f3438474490318a7cd69b5154 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:26.354807 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a56efbf9-e957-40dd-93d3-17fb88fdafa5 None None] MFA Rules not processed for user `69012c22491143229137d06b0920a8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:26.356078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a56efbf9-e957-40dd-93d3-17fb88fdafa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:26.431005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1059/2113] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:26.435333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.437463 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:26.548031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef0b00-9333-4aad-9a8d-b6d4cbf3b02d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.553519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f2b57-4531-425d-88aa-d61e7119ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.554947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f2b57-4531-425d-88aa-d61e7119ce6d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.555269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f2b57-4531-425d-88aa-d61e7119ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.555592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f2b57-4531-425d-88aa-d61e7119ce6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.556438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f2b57-4531-425d-88aa-d61e7119ce6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.558742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f2b57-4531-425d-88aa-d61e7119ce6d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.689733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1055/2114] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:26 2022] POST /identity/v3/projects => generated 369 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:26.693458 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56efbf9-e957-40dd-93d3-17fb88fdafa5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.705845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56efbf9-e957-40dd-93d3-17fb88fdafa5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.771734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a170f0-ede2-4cc6-9fad-4566e19e8e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.772492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a170f0-ede2-4cc6-9fad-4566e19e8e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.772865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a170f0-ede2-4cc6-9fad-4566e19e8e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.773242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a170f0-ede2-4cc6-9fad-4566e19e8e94 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.774005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a170f0-ede2-4cc6-9fad-4566e19e8e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.776175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a170f0-ede2-4cc6-9fad-4566e19e8e94 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.817337 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:26.871999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1060/2115] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:26 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:26.876081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f2b57-4531-425d-88aa-d61e7119ce6d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.891647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f2b57-4531-425d-88aa-d61e7119ce6d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.896581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05226dfe-ae0f-453a-87a8-a50ddcd7975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.897524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226dfe-ae0f-453a-87a8-a50ddcd7975c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.899404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226dfe-ae0f-453a-87a8-a50ddcd7975c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.899404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226dfe-ae0f-453a-87a8-a50ddcd7975c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:26.899404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05226dfe-ae0f-453a-87a8-a50ddcd7975c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:26.900486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05226dfe-ae0f-453a-87a8-a50ddcd7975c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:26.936344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1056/2116] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:26.937610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a170f0-ede2-4cc6-9fad-4566e19e8e94 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:26.963219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a170f0-ede2-4cc6-9fad-4566e19e8e94 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:26.968269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8577-f852-49c2-a392-43712861a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:26.969415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8577-f852-49c2-a392-43712861a957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:26.969700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8577-f852-49c2-a392-43712861a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:26.970182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8577-f852-49c2-a392-43712861a957 admin admin] PATH_INFO: `/v3/projects/49437efbaa4d43f98990bd9286fe0600/users/744be1898f5043be8793998ecdedc38a/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:27.008547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd8577-f852-49c2-a392-43712861a957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49437efbaa4d43f98990bd9286fe0600, user_id=744be1898f5043be8793998ecdedc38a, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:27.011123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd8577-f852-49c2-a392-43712861a957 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:27.093040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1061/2117] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:26 2022] PUT /identity/v3/projects/49437efbaa4d43f98990bd9286fe0600/users/744be1898f5043be8793998ecdedc38a/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:27.096857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05226dfe-ae0f-453a-87a8-a50ddcd7975c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:27.111738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05226dfe-ae0f-453a-87a8-a50ddcd7975c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:27.289910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b713a-a61e-4959-bdb0-25b46a79789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:27.290626 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b713a-a61e-4959-bdb0-25b46a79789f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:27.291047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b713a-a61e-4959-bdb0-25b46a79789f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:27.291327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b713a-a61e-4959-bdb0-25b46a79789f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:27.295160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b713a-a61e-4959-bdb0-25b46a79789f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:27.295160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b713a-a61e-4959-bdb0-25b46a79789f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:27.317407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1057/2118] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:27.324079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8577-f852-49c2-a392-43712861a957 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:27.339406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8577-f852-49c2-a392-43712861a957 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:27.345033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3c814-7689-4f0f-8e2e-e4a9021957aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:27.346309 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3c814-7689-4f0f-8e2e-e4a9021957aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:27.346890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3c814-7689-4f0f-8e2e-e4a9021957aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:27.347395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3c814-7689-4f0f-8e2e-e4a9021957aa admin admin] PATH_INFO: `/v3/projects/49437efbaa4d43f98990bd9286fe0600/users/744be1898f5043be8793998ecdedc38a/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:27.350072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3c814-7689-4f0f-8e2e-e4a9021957aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=49437efbaa4d43f98990bd9286fe0600, user_id=744be1898f5043be8793998ecdedc38a, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:27.356161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3c814-7689-4f0f-8e2e-e4a9021957aa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:27.370760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b713a-a61e-4959-bdb0-25b46a79789f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:27.372789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fa5b713a-a61e-4959-bdb0-25b46a79789f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:27.399773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b713a-a61e-4959-bdb0-25b46a79789f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:27.421811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1062/2119] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:27 2022] PUT /identity/v3/projects/49437efbaa4d43f98990bd9286fe0600/users/744be1898f5043be8793998ecdedc38a/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:27.427456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf512c6-a641-4cad-a954-a6c382e8a7cf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:27.427456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf512c6-a641-4cad-a954-a6c382e8a7cf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:27.427456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf512c6-a641-4cad-a954-a6c382e8a7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:27.490200 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9cf512c6-a641-4cad-a954-a6c382e8a7cf None None] MFA Rules not processed for user `744be1898f5043be8793998ecdedc38a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:27.494307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9cf512c6-a641-4cad-a954-a6c382e8a7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:27.528954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:27.530283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:27.530562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:27.530830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] PATH_INFO: `/v3/projects/7a1f8c8de2d847dfb4169e4aecab62c1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:27.532032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1f8c8de2d847dfb4169e4aecab62c1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:27.534390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:27.584026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1063/2120] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:27 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:27.585939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0586-2d78-4a1a-bc93-ce9ed350b160 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:27.586223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0586-2d78-4a1a-bc93-ce9ed350b160 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:27.586763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e0586-2d78-4a1a-bc93-ce9ed350b160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:27.614766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5e2e0586-2d78-4a1a-bc93-ce9ed350b160 None None] MFA Rules not processed for user `5290a9196a8a48c5bfbefc108c58fffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:27.616013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5e2e0586-2d78-4a1a-bc93-ce9ed350b160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:27.668541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1f8c8de2d847dfb4169e4aecab62c1', 'request_id': 'req-8e7a6009-dc54-4b4f-9608-6d03fc3036da'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:27.677876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1f8c8de2d847dfb4169e4aecab62c1', 'request_id': 'req-8e7a6009-dc54-4b4f-9608-6d03fc3036da'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:27.684422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1f8c8de2d847dfb4169e4aecab62c1', 'request_id': 'req-8e7a6009-dc54-4b4f-9608-6d03fc3036da'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:27.688604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1064/2121] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:27.689679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e0586-2d78-4a1a-bc93-ce9ed350b160 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:27.690921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5e2e0586-2d78-4a1a-bc93-ce9ed350b160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:27.746319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e0586-2d78-4a1a-bc93-ce9ed350b160 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:27.794280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afaf568-4cf3-4fc9-a77f-c12585a85deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:27.794897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaf568-4cf3-4fc9-a77f-c12585a85deb service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:27.795179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaf568-4cf3-4fc9-a77f-c12585a85deb service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:27.795450 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaf568-4cf3-4fc9-a77f-c12585a85deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:27.797971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] The token cache is being invalidate because project 7a1f8c8de2d847dfb4169e4aecab62c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:27.798256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:27.798903 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:27.800411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1058/2122] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:27 2022] DELETE /identity/v3/projects/7a1f8c8de2d847dfb4169e4aecab62c1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:27.801232 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:27.802478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:27.862489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afaf568-4cf3-4fc9-a77f-c12585a85deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:27.863969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afaf568-4cf3-4fc9-a77f-c12585a85deb service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:27.866887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a6009-dc54-4b4f-9608-6d03fc3036da admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:27.871693 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eea78e-c54a-47bb-87be-095e69b689f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:27.872364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eea78e-c54a-47bb-87be-095e69b689f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:27.872636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eea78e-c54a-47bb-87be-095e69b689f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:27.872905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eea78e-c54a-47bb-87be-095e69b689f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:27.873596 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eea78e-c54a-47bb-87be-095e69b689f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:27.874627 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1065/2123] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:27 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:27.875463 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eea78e-c54a-47bb-87be-095e69b689f3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:27.875887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce8ccb-b852-429d-93c2-1501edec0ca8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:27.876143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce8ccb-b852-429d-93c2-1501edec0ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:27.876414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce8ccb-b852-429d-93c2-1501edec0ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:27.894259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:27.899287 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8cce8ccb-b852-429d-93c2-1501edec0ca8 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:27.900521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8cce8ccb-b852-429d-93c2-1501edec0ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:27.909625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1066/2124] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:27.918596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d3274-506d-4048-b3cb-e3afe2542b25 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:27.918883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d3274-506d-4048-b3cb-e3afe2542b25 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:27.919155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d3274-506d-4048-b3cb-e3afe2542b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:27.939440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5a3d3274-506d-4048-b3cb-e3afe2542b25 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:27.940631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5a3d3274-506d-4048-b3cb-e3afe2542b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:27.951510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1067/2125] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:27.957620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d3274-506d-4048-b3cb-e3afe2542b25 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:27.966100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d3274-506d-4048-b3cb-e3afe2542b25 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:27.970926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355ed06-113b-477a-81ca-3b6bfba6dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:27.971552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ed06-113b-477a-81ca-3b6bfba6dc1b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:27.971827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ed06-113b-477a-81ca-3b6bfba6dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:27.972100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ed06-113b-477a-81ca-3b6bfba6dc1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:27.972804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355ed06-113b-477a-81ca-3b6bfba6dc1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:27.973109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355ed06-113b-477a-81ca-3b6bfba6dc1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:27.975015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355ed06-113b-477a-81ca-3b6bfba6dc1b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:27.983726 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1059/2126] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:27 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:27.987973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eea78e-c54a-47bb-87be-095e69b689f3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:27.989654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1068/2127] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:39:27.994356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355ed06-113b-477a-81ca-3b6bfba6dc1b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:28.009317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355ed06-113b-477a-81ca-3b6bfba6dc1b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:28.061566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eea78e-c54a-47bb-87be-095e69b689f3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:28.072702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5b07e-a6c9-4471-b8f6-f6ef8ee6c992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:28.073378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5b07e-a6c9-4471-b8f6-f6ef8ee6c992 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.073658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5b07e-a6c9-4471-b8f6-f6ef8ee6c992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.073929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5b07e-a6c9-4471-b8f6-f6ef8ee6c992 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.074598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5b07e-a6c9-4471-b8f6-f6ef8ee6c992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:28.076574 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5b07e-a6c9-4471-b8f6-f6ef8ee6c992 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:28.091938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da3a14-49b3-4b43-94dd-9946fce6f992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:28.092657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3a14-49b3-4b43-94dd-9946fce6f992 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.092940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3a14-49b3-4b43-94dd-9946fce6f992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.093344 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3a14-49b3-4b43-94dd-9946fce6f992 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.094018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da3a14-49b3-4b43-94dd-9946fce6f992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:28.095985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da3a14-49b3-4b43-94dd-9946fce6f992 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:28.195679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1060/2128] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:27 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:28.196853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5b07e-a6c9-4471-b8f6-f6ef8ee6c992 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:28.198814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f3e5b07e-a6c9-4471-b8f6-f6ef8ee6c992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:28.223716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1069/2129] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:27 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:28.223716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da3a14-49b3-4b43-94dd-9946fce6f992 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:28.280545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5b07e-a6c9-4471-b8f6-f6ef8ee6c992 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:28.291695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da3a14-49b3-4b43-94dd-9946fce6f992 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:28.297464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bfcd6-3043-46ce-9cf3-1dfa5ff304be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:28.298193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bfcd6-3043-46ce-9cf3-1dfa5ff304be admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.298505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bfcd6-3043-46ce-9cf3-1dfa5ff304be admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.299334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bfcd6-3043-46ce-9cf3-1dfa5ff304be admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.299707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bfcd6-3043-46ce-9cf3-1dfa5ff304be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:28.301480 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bfcd6-3043-46ce-9cf3-1dfa5ff304be admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:28.313184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1070/2130] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:28.314146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bfcd6-3043-46ce-9cf3-1dfa5ff304be admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:28.325099 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bfcd6-3043-46ce-9cf3-1dfa5ff304be admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:28.330231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770332b5-f1f7-46df-94e4-a75f792ac7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:28.330930 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770332b5-f1f7-46df-94e4-a75f792ac7bc admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.331303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770332b5-f1f7-46df-94e4-a75f792ac7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.331579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770332b5-f1f7-46df-94e4-a75f792ac7bc admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.332283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770332b5-f1f7-46df-94e4-a75f792ac7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:28.334455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770332b5-f1f7-46df-94e4-a75f792ac7bc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:28.342221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92ef64-118b-4be9-9165-f4d45a6a9a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:28.343369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92ef64-118b-4be9-9165-f4d45a6a9a35 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.350058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92ef64-118b-4be9-9165-f4d45a6a9a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.350058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92ef64-118b-4be9-9165-f4d45a6a9a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.350058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d92ef64-118b-4be9-9165-f4d45a6a9a35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:28.422535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92ef64-118b-4be9-9165-f4d45a6a9a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:28.424476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92ef64-118b-4be9-9165-f4d45a6a9a35 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:28.437331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1061/2131] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:28.438617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92ef64-118b-4be9-9165-f4d45a6a9a35 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:28.453165 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92ef64-118b-4be9-9165-f4d45a6a9a35 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:28.458660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e5f13-d1fc-4ace-9d97-1577b04efe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:28.459346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e5f13-d1fc-4ace-9d97-1577b04efe2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.459631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e5f13-d1fc-4ace-9d97-1577b04efe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.459936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e5f13-d1fc-4ace-9d97-1577b04efe2b admin admin] PATH_INFO: `/v3/projects/4fdea2c410104d10ae8226ec272526e4/users/d8ef13733c224600820ff27f4aac4696/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.472052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1071/2132] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:28 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:28.473368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770332b5-f1f7-46df-94e4-a75f792ac7bc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:28.483084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e5f13-d1fc-4ace-9d97-1577b04efe2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdea2c410104d10ae8226ec272526e4, user_id=d8ef13733c224600820ff27f4aac4696, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:28.485012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e5f13-d1fc-4ace-9d97-1577b04efe2b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:28.501343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770332b5-f1f7-46df-94e4-a75f792ac7bc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:28.510743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896eefc-e9fc-4fce-80cd-ca85840a85f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:28.513531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896eefc-e9fc-4fce-80cd-ca85840a85f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.513531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896eefc-e9fc-4fce-80cd-ca85840a85f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.513531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896eefc-e9fc-4fce-80cd-ca85840a85f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.513847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896eefc-e9fc-4fce-80cd-ca85840a85f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:28.515671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896eefc-e9fc-4fce-80cd-ca85840a85f8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:28.528793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1072/2133] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:28.533041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896eefc-e9fc-4fce-80cd-ca85840a85f8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:28.546808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896eefc-e9fc-4fce-80cd-ca85840a85f8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:28.552632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219be98-bdd8-4245-bd11-6c501103b226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:28.553436 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219be98-bdd8-4245-bd11-6c501103b226 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.554431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219be98-bdd8-4245-bd11-6c501103b226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.554723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219be98-bdd8-4245-bd11-6c501103b226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.555437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219be98-bdd8-4245-bd11-6c501103b226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:28.557499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219be98-bdd8-4245-bd11-6c501103b226 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:28.571016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1062/2134] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:28 2022] PUT /identity/v3/projects/4fdea2c410104d10ae8226ec272526e4/users/d8ef13733c224600820ff27f4aac4696/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:28.575091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e5f13-d1fc-4ace-9d97-1577b04efe2b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:28.581614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1073/2135] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:28.582701 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219be98-bdd8-4245-bd11-6c501103b226 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:28.593836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219be98-bdd8-4245-bd11-6c501103b226 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:28.601333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:28.695941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e5f13-d1fc-4ace-9d97-1577b04efe2b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:28.697625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc071f-7f71-4a75-8a89-5f55d8769c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:28.698487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc071f-7f71-4a75-8a89-5f55d8769c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.698837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc071f-7f71-4a75-8a89-5f55d8769c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.699225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc071f-7f71-4a75-8a89-5f55d8769c8d admin admin] PATH_INFO: `/v3/projects/07c67aabdb494905926240f0581cb1b5/users/2e78ceeae73b4caaab9b821a46005859/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.702224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf38eb-366d-46c6-b75b-3508dd09d607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:28.703714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf38eb-366d-46c6-b75b-3508dd09d607 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.704007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf38eb-366d-46c6-b75b-3508dd09d607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.704283 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf38eb-366d-46c6-b75b-3508dd09d607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.704986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf38eb-366d-46c6-b75b-3508dd09d607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:28.707074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf38eb-366d-46c6-b75b-3508dd09d607 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:28.716711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc071f-7f71-4a75-8a89-5f55d8769c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c67aabdb494905926240f0581cb1b5, user_id=2e78ceeae73b4caaab9b821a46005859, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:28.719784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc071f-7f71-4a75-8a89-5f55d8769c8d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:28.721887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1063/2136] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:28.725305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf38eb-366d-46c6-b75b-3508dd09d607 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:28.736080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf38eb-366d-46c6-b75b-3508dd09d607 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:28.743404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d987978-a3cd-4458-b23d-765cd6c9354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:28.744095 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d987978-a3cd-4458-b23d-765cd6c9354b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.744372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d987978-a3cd-4458-b23d-765cd6c9354b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.744644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d987978-a3cd-4458-b23d-765cd6c9354b admin admin] PATH_INFO: `/v3/projects/4fdea2c410104d10ae8226ec272526e4/users/d8ef13733c224600820ff27f4aac4696/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.746673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d987978-a3cd-4458-b23d-765cd6c9354b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdea2c410104d10ae8226ec272526e4, user_id=d8ef13733c224600820ff27f4aac4696, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:28.749338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d987978-a3cd-4458-b23d-765cd6c9354b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:28.766280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1064/2137] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:28 2022] PUT /identity/v3/projects/4fdea2c410104d10ae8226ec272526e4/users/d8ef13733c224600820ff27f4aac4696/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:28.869967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1074/2138] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:28 2022] PUT /identity/v3/projects/07c67aabdb494905926240f0581cb1b5/users/2e78ceeae73b4caaab9b821a46005859/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:28.883219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f69c5-912e-42dc-9b44-07a28cedabd6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:28.883505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f69c5-912e-42dc-9b44-07a28cedabd6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:28.884322 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f69c5-912e-42dc-9b44-07a28cedabd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:28.919271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-792f69c5-912e-42dc-9b44-07a28cedabd6 None None] MFA Rules not processed for user `2e78ceeae73b4caaab9b821a46005859`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:28.920635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-792f69c5-912e-42dc-9b44-07a28cedabd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:29.045641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1065/2139] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:29.117328 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc071f-7f71-4a75-8a89-5f55d8769c8d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:29.119238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7efc071f-7f71-4a75-8a89-5f55d8769c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:29.190122 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc071f-7f71-4a75-8a89-5f55d8769c8d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:29.195166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c547d8-5baf-496e-bfd6-9bc8ec6e6022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:29.195959 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c547d8-5baf-496e-bfd6-9bc8ec6e6022 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:29.196296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c547d8-5baf-496e-bfd6-9bc8ec6e6022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:29.196573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c547d8-5baf-496e-bfd6-9bc8ec6e6022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:29.205690 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c547d8-5baf-496e-bfd6-9bc8ec6e6022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:29.207147 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c547d8-5baf-496e-bfd6-9bc8ec6e6022 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:29.225359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1075/2140] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:29.824224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:29.920716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:31.618646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:31.713699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:32.600223 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f69c5-912e-42dc-9b44-07a28cedabd6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:32.723385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f69c5-912e-42dc-9b44-07a28cedabd6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:32.733580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:32.734265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:32.734509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:32.734857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] PATH_INFO: `/v3/users/2e78ceeae73b4caaab9b821a46005859` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:32.736373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e78ceeae73b4caaab9b821a46005859)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:32.738620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:32.987853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e78ceeae73b4caaab9b821a46005859'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:32.988569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e78ceeae73b4caaab9b821a46005859'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.110378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e78ceeae73b4caaab9b821a46005859'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.121181 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e78ceeae73b4caaab9b821a46005859'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.143511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e78ceeae73b4caaab9b821a46005859'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:33.196366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1066/2141] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:32 2022] DELETE /identity/v3/users/2e78ceeae73b4caaab9b821a46005859 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:33.202077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ebd1d-5621-4c26-b349-b95c648774cb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.207621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ebd1d-5621-4c26-b349-b95c648774cb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.213272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ebd1d-5621-4c26-b349-b95c648774cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.232633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:33.241948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c10ebd1d-5621-4c26-b349-b95c648774cb None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:33.245896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c10ebd1d-5621-4c26-b349-b95c648774cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:33.340870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1076/2142] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:33.351236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:33.353169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:33.428726 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aece66b-a743-44e0-a55f-ff8f81a9e84e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:33.432842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb0168-9bd2-410a-b8a9-efc5ae29ea3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:33.433634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb0168-9bd2-410a-b8a9-efc5ae29ea3e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:33.433922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb0168-9bd2-410a-b8a9-efc5ae29ea3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:33.434197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb0168-9bd2-410a-b8a9-efc5ae29ea3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:33.445217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb0168-9bd2-410a-b8a9-efc5ae29ea3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:33.447182 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb0168-9bd2-410a-b8a9-efc5ae29ea3e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:33.457326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1067/2143] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:34.229470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:34.363657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ebd1d-5621-4c26-b349-b95c648774cb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:34.365277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c10ebd1d-5621-4c26-b349-b95c648774cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:34.395773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ebd1d-5621-4c26-b349-b95c648774cb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:34.395773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:34.395773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:34.395773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:34.396122 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] PATH_INFO: `/v3/projects/07c67aabdb494905926240f0581cb1b5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:34.396122 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c67aabdb494905926240f0581cb1b5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:34.398569 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:34.600100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb0168-9bd2-410a-b8a9-efc5ae29ea3e service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:34.601866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bceb0168-9bd2-410a-b8a9-efc5ae29ea3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:34.606800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c67aabdb494905926240f0581cb1b5', 'request_id': 'req-bf82f469-4546-47ea-abc1-020ad725564b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:34.615329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c67aabdb494905926240f0581cb1b5', 'request_id': 'req-bf82f469-4546-47ea-abc1-020ad725564b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:34.625346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb0168-9bd2-410a-b8a9-efc5ae29ea3e service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:34.627341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c67aabdb494905926240f0581cb1b5', 'request_id': 'req-bf82f469-4546-47ea-abc1-020ad725564b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:34.701749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37233600-a9a8-4626-851d-70393200a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:34.702402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233600-a9a8-4626-851d-70393200a815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:34.702681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233600-a9a8-4626-851d-70393200a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:34.702953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233600-a9a8-4626-851d-70393200a815 admin admin] PATH_INFO: `/v3/users/69012c22491143229137d06b0920a8bc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:34.705448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37233600-a9a8-4626-851d-70393200a815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69012c22491143229137d06b0920a8bc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:34.706098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37233600-a9a8-4626-851d-70393200a815 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:34.794998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] The token cache is being invalidate because project 07c67aabdb494905926240f0581cb1b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:34.795535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:34.796377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bf82f469-4546-47ea-abc1-020ad725564b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:34.798121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1077/2144] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:34 2022] DELETE /identity/v3/projects/07c67aabdb494905926240f0581cb1b5 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:34.804273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c469c3-5069-4c4d-bb73-20aaf2af0a8b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:34.804765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c469c3-5069-4c4d-bb73-20aaf2af0a8b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:34.805219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c469c3-5069-4c4d-bb73-20aaf2af0a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:34.826125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a4c469c3-5069-4c4d-bb73-20aaf2af0a8b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:34.827290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a4c469c3-5069-4c4d-bb73-20aaf2af0a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:34.836174 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1078/2145] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:34.844402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a285142-72c6-4cb1-b692-b8fd90222677 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:34.844834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a285142-72c6-4cb1-b692-b8fd90222677 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:34.845115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a285142-72c6-4cb1-b692-b8fd90222677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:34.869640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9a285142-72c6-4cb1-b692-b8fd90222677 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:34.871007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a285142-72c6-4cb1-b692-b8fd90222677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:34.879540 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1079/2146] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:34.884900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a285142-72c6-4cb1-b692-b8fd90222677 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:34.899264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a285142-72c6-4cb1-b692-b8fd90222677 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:34.904689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9445ad-62b9-46e6-b4e9-e32b93568d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:34.905463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9445ad-62b9-46e6-b4e9-e32b93568d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:34.905865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9445ad-62b9-46e6-b4e9-e32b93568d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:34.906238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9445ad-62b9-46e6-b4e9-e32b93568d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:34.907174 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9445ad-62b9-46e6-b4e9-e32b93568d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:34.907577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9445ad-62b9-46e6-b4e9-e32b93568d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:34.910566 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9445ad-62b9-46e6-b4e9-e32b93568d93 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:34.941049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37233600-a9a8-4626-851d-70393200a815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69012c22491143229137d06b0920a8bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:34.942765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37233600-a9a8-4626-851d-70393200a815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69012c22491143229137d06b0920a8bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:34.964299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1080/2147] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:34.970494 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9445ad-62b9-46e6-b4e9-e32b93568d93 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:34.997082 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9445ad-62b9-46e6-b4e9-e32b93568d93 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:35.003247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e153a76-4aeb-48ef-995e-62d4faba26ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:35.004823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e153a76-4aeb-48ef-995e-62d4faba26ea admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.005315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e153a76-4aeb-48ef-995e-62d4faba26ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.005682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e153a76-4aeb-48ef-995e-62d4faba26ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.007178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e153a76-4aeb-48ef-995e-62d4faba26ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:35.011394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e153a76-4aeb-48ef-995e-62d4faba26ea admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:35.040185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37233600-a9a8-4626-851d-70393200a815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69012c22491143229137d06b0920a8bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.040810 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37233600-a9a8-4626-851d-70393200a815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69012c22491143229137d06b0920a8bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.071786 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37233600-a9a8-4626-851d-70393200a815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69012c22491143229137d06b0920a8bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:35.108994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1068/2148] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:34 2022] DELETE /identity/v3/users/69012c22491143229137d06b0920a8bc => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:35.118056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4289-41fe-4425-813e-d9429e9bbc8f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.118337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4289-41fe-4425-813e-d9429e9bbc8f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.118607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4289-41fe-4425-813e-d9429e9bbc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.149659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c42c4289-41fe-4425-813e-d9429e9bbc8f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:35.151171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c42c4289-41fe-4425-813e-d9429e9bbc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:35.181814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1081/2149] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:34 2022] POST /identity/v3/projects => generated 375 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:35.184084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e153a76-4aeb-48ef-995e-62d4faba26ea admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:35.186270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9e153a76-4aeb-48ef-995e-62d4faba26ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:35.254670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1069/2150] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:35.263625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4289-41fe-4425-813e-d9429e9bbc8f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:35.265633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c42c4289-41fe-4425-813e-d9429e9bbc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:35.360137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e153a76-4aeb-48ef-995e-62d4faba26ea admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:35.371025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4289-41fe-4425-813e-d9429e9bbc8f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:35.379014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11552d31-15ce-4e04-a1bc-28953338c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:35.379773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552d31-15ce-4e04-a1bc-28953338c0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.380111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552d31-15ce-4e04-a1bc-28953338c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.380457 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552d31-15ce-4e04-a1bc-28953338c0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.382992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11552d31-15ce-4e04-a1bc-28953338c0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:35.386162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11552d31-15ce-4e04-a1bc-28953338c0b6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:35.444739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1151c-ba8c-4178-bb9d-409849d4b61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:35.445659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1151c-ba8c-4178-bb9d-409849d4b61e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.445940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1151c-ba8c-4178-bb9d-409849d4b61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.446213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1151c-ba8c-4178-bb9d-409849d4b61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.457190 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1151c-ba8c-4178-bb9d-409849d4b61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:35.460001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1151c-ba8c-4178-bb9d-409849d4b61e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:35.470134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1070/2151] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:35.471380 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308a56-7462-471f-9a3a-7eac2aee6531 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.472110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308a56-7462-471f-9a3a-7eac2aee6531 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.472110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308a56-7462-471f-9a3a-7eac2aee6531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.494300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f308a56-7462-471f-9a3a-7eac2aee6531 None None] MFA Rules not processed for user `28831626fd594dc281d1ddd1aa3bab2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:35.495546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f308a56-7462-471f-9a3a-7eac2aee6531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:35.557124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1082/2152] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:35 2022] POST /identity/v3/users => generated 288 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:35.562081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11552d31-15ce-4e04-a1bc-28953338c0b6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:35.586884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11552d31-15ce-4e04-a1bc-28953338c0b6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:35.593543 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ab6d3-a39b-4063-bd1d-9de76b51c035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:35.594833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ab6d3-a39b-4063-bd1d-9de76b51c035 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.595901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ab6d3-a39b-4063-bd1d-9de76b51c035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.598679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ab6d3-a39b-4063-bd1d-9de76b51c035 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.598679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ab6d3-a39b-4063-bd1d-9de76b51c035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:35.599558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ab6d3-a39b-4063-bd1d-9de76b51c035 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:35.616115 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1071/2153] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:35.640440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1083/2154] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:35.644541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308a56-7462-471f-9a3a-7eac2aee6531 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:35.661934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308a56-7462-471f-9a3a-7eac2aee6531 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:35.669374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78076cae-8526-478f-bc4e-d51dbba379a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:35.670072 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78076cae-8526-478f-bc4e-d51dbba379a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.670356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78076cae-8526-478f-bc4e-d51dbba379a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.670635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78076cae-8526-478f-bc4e-d51dbba379a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.673724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78076cae-8526-478f-bc4e-d51dbba379a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:35.677409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78076cae-8526-478f-bc4e-d51dbba379a2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:35.694271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1072/2155] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:35.698786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ab6d3-a39b-4063-bd1d-9de76b51c035 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:35.712638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ab6d3-a39b-4063-bd1d-9de76b51c035 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:35.717661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeece3-5c8b-44de-a867-dd1487ddfaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:35.718347 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeece3-5c8b-44de-a867-dd1487ddfaa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.725380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeece3-5c8b-44de-a867-dd1487ddfaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.725380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeece3-5c8b-44de-a867-dd1487ddfaa3 admin admin] PATH_INFO: `/v3/projects/753406bcd5f843ceb39c79f8e96828d9/users/6e91fc978b9a45bf9708b5ab85f3d8eb/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.736147 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeece3-5c8b-44de-a867-dd1487ddfaa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=753406bcd5f843ceb39c79f8e96828d9, user_id=6e91fc978b9a45bf9708b5ab85f3d8eb, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:35.739025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeece3-5c8b-44de-a867-dd1487ddfaa3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:35.868052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1084/2156] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:35 2022] PUT /identity/v3/projects/753406bcd5f843ceb39c79f8e96828d9/users/6e91fc978b9a45bf9708b5ab85f3d8eb/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:35.880488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca984bb-a986-4bfa-afdd-3ec6a489888f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:35.880769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca984bb-a986-4bfa-afdd-3ec6a489888f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:35.881246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca984bb-a986-4bfa-afdd-3ec6a489888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:35.953349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0ca984bb-a986-4bfa-afdd-3ec6a489888f None None] MFA Rules not processed for user `6e91fc978b9a45bf9708b5ab85f3d8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:35.954967 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0ca984bb-a986-4bfa-afdd-3ec6a489888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:36.004118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:36.087068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:36.150821 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1073/2157] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:36.175059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeece3-5c8b-44de-a867-dd1487ddfaa3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:36.179433 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fdfeece3-5c8b-44de-a867-dd1487ddfaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:36.327366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeece3-5c8b-44de-a867-dd1487ddfaa3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:36.344657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e40af-2d04-4d42-83f7-ecb004a95a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:36.345348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e40af-2d04-4d42-83f7-ecb004a95a93 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:36.345687 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e40af-2d04-4d42-83f7-ecb004a95a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:36.345974 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e40af-2d04-4d42-83f7-ecb004a95a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:36.351710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca984bb-a986-4bfa-afdd-3ec6a489888f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:36.353482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0ca984bb-a986-4bfa-afdd-3ec6a489888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:36.366841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e40af-2d04-4d42-83f7-ecb004a95a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:36.368503 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e40af-2d04-4d42-83f7-ecb004a95a93 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:36.379826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1085/2158] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:36.504718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca984bb-a986-4bfa-afdd-3ec6a489888f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:36.530733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:36.531496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:36.531835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:36.532176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] PATH_INFO: `/v3/projects/9bb3eae65a6c41c3af9ec80f9ea983d6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:36.534423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb3eae65a6c41c3af9ec80f9ea983d6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:36.538824 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:36.683105 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb3eae65a6c41c3af9ec80f9ea983d6', 'request_id': 'req-532a27e6-a636-43c7-b348-d9c989ba7057'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:36.697871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb3eae65a6c41c3af9ec80f9ea983d6', 'request_id': 'req-532a27e6-a636-43c7-b348-d9c989ba7057'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:36.705413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb3eae65a6c41c3af9ec80f9ea983d6', 'request_id': 'req-532a27e6-a636-43c7-b348-d9c989ba7057'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:36.776542 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfb6a9-ffc2-446e-b342-fbe02985aace None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:36.777192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfb6a9-ffc2-446e-b342-fbe02985aace None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:36.777669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfb6a9-ffc2-446e-b342-fbe02985aace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:36.798157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] The token cache is being invalidate because project 9bb3eae65a6c41c3af9ec80f9ea983d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:36.798623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:36.799366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:36.801378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1074/2159] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:36 2022] DELETE /identity/v3/projects/9bb3eae65a6c41c3af9ec80f9ea983d6 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:36.805729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:36.807415 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:36.833282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-afbfb6a9-ffc2-446e-b342-fbe02985aace None None] MFA Rules not processed for user `d8ef13733c224600820ff27f4aac4696`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:36.834599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-afbfb6a9-ffc2-446e-b342-fbe02985aace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:36.923000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a27e6-a636-43c7-b348-d9c989ba7057 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:36.931609 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970d6da-f2ec-4342-aedd-23224f0cda62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:36.932390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d6da-f2ec-4342-aedd-23224f0cda62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:36.932848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d6da-f2ec-4342-aedd-23224f0cda62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:36.933125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d6da-f2ec-4342-aedd-23224f0cda62 admin admin] PATH_INFO: `/v3/users/744be1898f5043be8793998ecdedc38a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:36.934773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970d6da-f2ec-4342-aedd-23224f0cda62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744be1898f5043be8793998ecdedc38a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:36.936801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970d6da-f2ec-4342-aedd-23224f0cda62 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:36.968273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1086/2160] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:36.985798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfb6a9-ffc2-446e-b342-fbe02985aace None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:36.988052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-afbfb6a9-ffc2-446e-b342-fbe02985aace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:37.092177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfb6a9-ffc2-446e-b342-fbe02985aace None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:37.099202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359116-8a77-4820-97cf-dda0ebde4d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:37.106240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359116-8a77-4820-97cf-dda0ebde4d10 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:37.106240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359116-8a77-4820-97cf-dda0ebde4d10 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:37.106240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359116-8a77-4820-97cf-dda0ebde4d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:37.106240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-68359116-8a77-4820-97cf-dda0ebde4d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:37.189575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68359116-8a77-4820-97cf-dda0ebde4d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:37.191425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68359116-8a77-4820-97cf-dda0ebde4d10 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:37.213663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1087/2161] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:37.270198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2970d6da-f2ec-4342-aedd-23224f0cda62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744be1898f5043be8793998ecdedc38a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:37.270938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2970d6da-f2ec-4342-aedd-23224f0cda62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744be1898f5043be8793998ecdedc38a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:37.348879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2970d6da-f2ec-4342-aedd-23224f0cda62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744be1898f5043be8793998ecdedc38a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:37.349814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2970d6da-f2ec-4342-aedd-23224f0cda62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744be1898f5043be8793998ecdedc38a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:37.394822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2970d6da-f2ec-4342-aedd-23224f0cda62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744be1898f5043be8793998ecdedc38a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:37.411312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1075/2162] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:36 2022] DELETE /identity/v3/users/744be1898f5043be8793998ecdedc38a => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:37.907557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:38.061463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359116-8a77-4820-97cf-dda0ebde4d10 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:38.096665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359116-8a77-4820-97cf-dda0ebde4d10 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:38.175253 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:38.178897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:38.179062 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:38.179690 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] PATH_INFO: `/v3/projects/49437efbaa4d43f98990bd9286fe0600` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:38.180539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=49437efbaa4d43f98990bd9286fe0600)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:38.182842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:38.344973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49437efbaa4d43f98990bd9286fe0600', 'request_id': 'req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:38.357825 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49437efbaa4d43f98990bd9286fe0600', 'request_id': 'req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:38.368156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49437efbaa4d43f98990bd9286fe0600', 'request_id': 'req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:38.478561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] The token cache is being invalidate because project 49437efbaa4d43f98990bd9286fe0600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:38.478561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:38.479149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e22a997-dcdd-4575-9a76-0d10bcb16b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:38.484707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1088/2163] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:38 2022] DELETE /identity/v3/projects/49437efbaa4d43f98990bd9286fe0600 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:38.486296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb26e99-f6a2-4103-bd79-6b8d44aef359 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:38.486767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb26e99-f6a2-4103-bd79-6b8d44aef359 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:38.486860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb26e99-f6a2-4103-bd79-6b8d44aef359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:38.531448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6bb26e99-f6a2-4103-bd79-6b8d44aef359 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:38.532447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6bb26e99-f6a2-4103-bd79-6b8d44aef359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:38.623380 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1076/2164] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:38.629223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537a44-5037-4b57-b11d-c360bb00c1d7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:38.629590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537a44-5037-4b57-b11d-c360bb00c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:38.629948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537a44-5037-4b57-b11d-c360bb00c1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:38.675609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-92537a44-5037-4b57-b11d-c360bb00c1d7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:38.676875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-92537a44-5037-4b57-b11d-c360bb00c1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:38.686396 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1089/2165] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:38.690774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb26e99-f6a2-4103-bd79-6b8d44aef359 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:38.707800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb26e99-f6a2-4103-bd79-6b8d44aef359 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:38.713340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58bd8-2d24-4f0c-90a1-b2f727625be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:38.713955 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58bd8-2d24-4f0c-90a1-b2f727625be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:38.714237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58bd8-2d24-4f0c-90a1-b2f727625be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:38.714513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58bd8-2d24-4f0c-90a1-b2f727625be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:38.715258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d58bd8-2d24-4f0c-90a1-b2f727625be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:38.715634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d58bd8-2d24-4f0c-90a1-b2f727625be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:38.717258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d58bd8-2d24-4f0c-90a1-b2f727625be4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:38.730291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1077/2166] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:39:38.734585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92537a44-5037-4b57-b11d-c360bb00c1d7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:38.744248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92537a44-5037-4b57-b11d-c360bb00c1d7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:38.749226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943552e-4d23-4bfe-b16b-e2898aa246ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:38.749742 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943552e-4d23-4bfe-b16b-e2898aa246ea admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:38.750006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943552e-4d23-4bfe-b16b-e2898aa246ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:38.750302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943552e-4d23-4bfe-b16b-e2898aa246ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:38.752604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943552e-4d23-4bfe-b16b-e2898aa246ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:38.754333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943552e-4d23-4bfe-b16b-e2898aa246ea admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:38.898842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1090/2167] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:38 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:38.902644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58bd8-2d24-4f0c-90a1-b2f727625be4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:38.919898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58bd8-2d24-4f0c-90a1-b2f727625be4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:38.998264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943552e-4d23-4bfe-b16b-e2898aa246ea admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:39.000133 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e943552e-4d23-4bfe-b16b-e2898aa246ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:39.005074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:39.019621 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a86c6-27b7-4ac8-bf0f-7cb010282740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:39.020399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a86c6-27b7-4ac8-bf0f-7cb010282740 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:39.020746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a86c6-27b7-4ac8-bf0f-7cb010282740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:39.021125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a86c6-27b7-4ac8-bf0f-7cb010282740 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:39.022789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a86c6-27b7-4ac8-bf0f-7cb010282740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:39.025886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a86c6-27b7-4ac8-bf0f-7cb010282740 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:39.075942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:39.161169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943552e-4d23-4bfe-b16b-e2898aa246ea admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:39.170140 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1078/2168] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:38 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:39.174127 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a86c6-27b7-4ac8-bf0f-7cb010282740 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:39.187259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a86c6-27b7-4ac8-bf0f-7cb010282740 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:39.213977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2488528-fdc1-4bfc-90b5-bb4c0aa430ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:39.219383 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2488528-fdc1-4bfc-90b5-bb4c0aa430ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:39.220317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31e342-f8f3-4504-b650-9736c35fae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:39.220835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2488528-fdc1-4bfc-90b5-bb4c0aa430ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:39.221390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2488528-fdc1-4bfc-90b5-bb4c0aa430ca admin admin] PATH_INFO: `/v3/users/52b8687dcb5342dfb76c4074b352cbc0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:39.222566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e342-f8f3-4504-b650-9736c35fae69 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:39.226093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2488528-fdc1-4bfc-90b5-bb4c0aa430ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b8687dcb5342dfb76c4074b352cbc0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:39.228144 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2488528-fdc1-4bfc-90b5-bb4c0aa430ca admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:39.229927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e342-f8f3-4504-b650-9736c35fae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:39.230294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31e342-f8f3-4504-b650-9736c35fae69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:39.231226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31e342-f8f3-4504-b650-9736c35fae69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:39.234787 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31e342-f8f3-4504-b650-9736c35fae69 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:39.292052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1079/2169] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:39.294315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31e342-f8f3-4504-b650-9736c35fae69 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:39.345856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31e342-f8f3-4504-b650-9736c35fae69 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:39.361918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf5a2d-a323-4c65-b50d-ecdafb5c6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:39.362710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5a2d-a323-4c65-b50d-ecdafb5c6290 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:39.363342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5a2d-a323-4c65-b50d-ecdafb5c6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:39.364650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5a2d-a323-4c65-b50d-ecdafb5c6290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:39.365934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf5a2d-a323-4c65-b50d-ecdafb5c6290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:39.368150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf5a2d-a323-4c65-b50d-ecdafb5c6290 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:39.401416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1080/2170] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:39.402718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf5a2d-a323-4c65-b50d-ecdafb5c6290 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:39.416474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf5a2d-a323-4c65-b50d-ecdafb5c6290 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:39.422133 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f54c0-0cbd-4c32-983e-0af94018678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:39.422910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f54c0-0cbd-4c32-983e-0af94018678a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:39.423264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f54c0-0cbd-4c32-983e-0af94018678a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:39.423619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f54c0-0cbd-4c32-983e-0af94018678a admin admin] PATH_INFO: `/v3/projects/953b585fd5524365a26ff67d37c5c16a/users/9af1e795619e4c20800625cedf6ab425/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:39.447971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f54c0-0cbd-4c32-983e-0af94018678a admin admin] RBAC: Authorizing `identity:create_grant(project_id=953b585fd5524365a26ff67d37c5c16a, user_id=9af1e795619e4c20800625cedf6ab425, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:39.450794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f54c0-0cbd-4c32-983e-0af94018678a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:39.550544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f2488528-fdc1-4bfc-90b5-bb4c0aa430ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b8687dcb5342dfb76c4074b352cbc0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:39.581420 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1081/2171] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:39 2022] PUT /identity/v3/projects/953b585fd5524365a26ff67d37c5c16a/users/9af1e795619e4c20800625cedf6ab425/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:39.592051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c5a09-74f2-4bee-a79c-7d91a3af6b07 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:39.592568 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c5a09-74f2-4bee-a79c-7d91a3af6b07 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:39.593051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c5a09-74f2-4bee-a79c-7d91a3af6b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:39.630379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b76c5a09-74f2-4bee-a79c-7d91a3af6b07 None None] MFA Rules not processed for user `9af1e795619e4c20800625cedf6ab425`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:39.637756 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f2488528-fdc1-4bfc-90b5-bb4c0aa430ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b8687dcb5342dfb76c4074b352cbc0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:39.638146 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b76c5a09-74f2-4bee-a79c-7d91a3af6b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:39.638552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f2488528-fdc1-4bfc-90b5-bb4c0aa430ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b8687dcb5342dfb76c4074b352cbc0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:39.643025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f2488528-fdc1-4bfc-90b5-bb4c0aa430ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b8687dcb5342dfb76c4074b352cbc0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:39.670605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f2488528-fdc1-4bfc-90b5-bb4c0aa430ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b8687dcb5342dfb76c4074b352cbc0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:39.707382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1091/2172] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:38 2022] DELETE /identity/v3/users/52b8687dcb5342dfb76c4074b352cbc0 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:39.714309 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33589ea4-a050-4e86-8be4-0bdd7ecddcdc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:39.718571 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33589ea4-a050-4e86-8be4-0bdd7ecddcdc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:39.719128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33589ea4-a050-4e86-8be4-0bdd7ecddcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:39.750947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1082/2173] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:39.752215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c5a09-74f2-4bee-a79c-7d91a3af6b07 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:39.753599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b76c5a09-74f2-4bee-a79c-7d91a3af6b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:39.763828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-33589ea4-a050-4e86-8be4-0bdd7ecddcdc None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:39.765252 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-33589ea4-a050-4e86-8be4-0bdd7ecddcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:39.924378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1092/2174] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:39.934476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33589ea4-a050-4e86-8be4-0bdd7ecddcdc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:39.935908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-33589ea4-a050-4e86-8be4-0bdd7ecddcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:39.946186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c5a09-74f2-4bee-a79c-7d91a3af6b07 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:39.954014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799c2b4-334c-4f2c-8d99-119d928ec187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:39.954727 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c2b4-334c-4f2c-8d99-119d928ec187 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:39.955073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c2b4-334c-4f2c-8d99-119d928ec187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:39.955419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c2b4-334c-4f2c-8d99-119d928ec187 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:39.956258 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799c2b4-334c-4f2c-8d99-119d928ec187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:39.958369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799c2b4-334c-4f2c-8d99-119d928ec187 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:40.013508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33589ea4-a050-4e86-8be4-0bdd7ecddcdc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:40.017358 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237deb6-cefd-4302-9e91-c602f8eb7045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:40.018364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237deb6-cefd-4302-9e91-c602f8eb7045 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:40.018364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237deb6-cefd-4302-9e91-c602f8eb7045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:40.018532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237deb6-cefd-4302-9e91-c602f8eb7045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:40.030348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237deb6-cefd-4302-9e91-c602f8eb7045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:40.033071 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237deb6-cefd-4302-9e91-c602f8eb7045 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:40.046343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1093/2175] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:40.149230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1083/2176] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:39 2022] POST /identity/v3/projects => generated 377 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:40.153564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237deb6-cefd-4302-9e91-c602f8eb7045 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:40.166243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237deb6-cefd-4302-9e91-c602f8eb7045 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:40.252258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c470796-a4be-46ab-923f-a5ecba8f2124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:40.254558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c470796-a4be-46ab-923f-a5ecba8f2124 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:40.254918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c470796-a4be-46ab-923f-a5ecba8f2124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:40.255196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c470796-a4be-46ab-923f-a5ecba8f2124 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:40.255993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c470796-a4be-46ab-923f-a5ecba8f2124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:40.273426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c470796-a4be-46ab-923f-a5ecba8f2124 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:40.388343 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1094/2177] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:40 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:40.392069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799c2b4-334c-4f2c-8d99-119d928ec187 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:40.403720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799c2b4-334c-4f2c-8d99-119d928ec187 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:40.413935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944bb41-175a-47b1-be0d-547f30b59497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:40.427261 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bb41-175a-47b1-be0d-547f30b59497 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:40.427843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bb41-175a-47b1-be0d-547f30b59497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:40.428352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bb41-175a-47b1-be0d-547f30b59497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:40.429553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944bb41-175a-47b1-be0d-547f30b59497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:40.431636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944bb41-175a-47b1-be0d-547f30b59497 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:40.456917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1084/2178] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:40.458210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c470796-a4be-46ab-923f-a5ecba8f2124 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:40.471228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c470796-a4be-46ab-923f-a5ecba8f2124 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:40.477963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34387767-bc6e-439c-9049-844284568761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:40.479030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34387767-bc6e-439c-9049-844284568761 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:40.479030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34387767-bc6e-439c-9049-844284568761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:40.479207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34387767-bc6e-439c-9049-844284568761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:40.479841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34387767-bc6e-439c-9049-844284568761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:40.481496 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34387767-bc6e-439c-9049-844284568761 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:40.495195 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1095/2179] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:40.497370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944bb41-175a-47b1-be0d-547f30b59497 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:40.508436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944bb41-175a-47b1-be0d-547f30b59497 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:40.514152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0b2fe-dc63-456d-935a-bb9bde9023af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:40.514906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b2fe-dc63-456d-935a-bb9bde9023af admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:40.515177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b2fe-dc63-456d-935a-bb9bde9023af admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:40.515450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0b2fe-dc63-456d-935a-bb9bde9023af admin admin] PATH_INFO: `/v3/projects/98f30fda222d45a5ab2c3bbe22ec57d5/users/1935c27f3d2a417b9b3f87a1a712e232/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:40.692398 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0b2fe-dc63-456d-935a-bb9bde9023af admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f30fda222d45a5ab2c3bbe22ec57d5, user_id=1935c27f3d2a417b9b3f87a1a712e232, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:40.700274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0b2fe-dc63-456d-935a-bb9bde9023af admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:40.785467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1085/2180] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:40 2022] PUT /identity/v3/projects/98f30fda222d45a5ab2c3bbe22ec57d5/users/1935c27f3d2a417b9b3f87a1a712e232/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:40.796064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e16e4c-70d6-4e54-8a53-af7bfc9b612c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:40.796689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e16e4c-70d6-4e54-8a53-af7bfc9b612c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:40.797091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e16e4c-70d6-4e54-8a53-af7bfc9b612c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:40.831583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-74e16e4c-70d6-4e54-8a53-af7bfc9b612c None None] MFA Rules not processed for user `1935c27f3d2a417b9b3f87a1a712e232`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:40.833068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-74e16e4c-70d6-4e54-8a53-af7bfc9b612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:40.952265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b408c-79c9-49a8-b230-e603993c98c6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:40.952761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b408c-79c9-49a8-b230-e603993c98c6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:40.953194 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b408c-79c9-49a8-b230-e603993c98c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:40.971966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1096/2181] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:40.973503 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e16e4c-70d6-4e54-8a53-af7bfc9b612c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:40.996656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b71b408c-79c9-49a8-b230-e603993c98c6 None None] MFA Rules not processed for user `5290a9196a8a48c5bfbefc108c58fffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:40.998102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b71b408c-79c9-49a8-b230-e603993c98c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:41.096912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1086/2182] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:41.114000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e16e4c-70d6-4e54-8a53-af7bfc9b612c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:41.122244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b54f-1846-4d35-a09e-16333374182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:41.123857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b54f-1846-4d35-a09e-16333374182c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:41.130844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b54f-1846-4d35-a09e-16333374182c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:41.131307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b54f-1846-4d35-a09e-16333374182c admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.132712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b54f-1846-4d35-a09e-16333374182c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:41.135086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b54f-1846-4d35-a09e-16333374182c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:41.222641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:41.290851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1097/2183] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:40 2022] POST /identity/v3/projects => generated 379 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:41.297870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b408c-79c9-49a8-b230-e603993c98c6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:41.309485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b408c-79c9-49a8-b230-e603993c98c6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:41.335957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b54f-1846-4d35-a09e-16333374182c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:41.343124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0255b54f-1846-4d35-a09e-16333374182c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:41.404541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db05b77-804e-4188-b395-920d485deb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:41.407039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05b77-804e-4188-b395-920d485deb5d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:41.407039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05b77-804e-4188-b395-920d485deb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:41.407320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05b77-804e-4188-b395-920d485deb5d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.408020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db05b77-804e-4188-b395-920d485deb5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:41.410619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db05b77-804e-4188-b395-920d485deb5d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:41.483895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b54f-1846-4d35-a09e-16333374182c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:41.507064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:41.507064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:41.507064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:41.507064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] PATH_INFO: `/v3/projects/1284ae44c50a4e109184dac2041e050b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.510522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1284ae44c50a4e109184dac2041e050b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:41.515766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:41.565969 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1087/2184] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:41 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:41.570336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db05b77-804e-4188-b395-920d485deb5d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:41.581097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db05b77-804e-4188-b395-920d485deb5d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:41.587961 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f9f5-6db3-4b80-ad90-4e88e6dde025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:41.588576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f9f5-6db3-4b80-ad90-4e88e6dde025 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:41.598138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f9f5-6db3-4b80-ad90-4e88e6dde025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:41.598138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f9f5-6db3-4b80-ad90-4e88e6dde025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.598138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982f9f5-6db3-4b80-ad90-4e88e6dde025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:41.598138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982f9f5-6db3-4b80-ad90-4e88e6dde025 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:41.602722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1088/2185] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:41.606713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f9f5-6db3-4b80-ad90-4e88e6dde025 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:41.617103 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f9f5-6db3-4b80-ad90-4e88e6dde025 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:41.625482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264f285-ce3f-4fbb-82ea-e7f9c50aba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:41.625482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f285-ce3f-4fbb-82ea-e7f9c50aba9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:41.625482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f285-ce3f-4fbb-82ea-e7f9c50aba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:41.625482 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f285-ce3f-4fbb-82ea-e7f9c50aba9b admin admin] PATH_INFO: `/v3/projects/94fc0363e64d4888a87ab4c5db85c7ea/users/a88a2d36a13a4cba8e389e4824fce252/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.651983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264f285-ce3f-4fbb-82ea-e7f9c50aba9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94fc0363e64d4888a87ab4c5db85c7ea, user_id=a88a2d36a13a4cba8e389e4824fce252, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:41.657978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264f285-ce3f-4fbb-82ea-e7f9c50aba9b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:41.670477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1284ae44c50a4e109184dac2041e050b', 'request_id': 'req-96176f4d-0136-4e12-bb26-9e3583aca6aa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:41.677456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1284ae44c50a4e109184dac2041e050b', 'request_id': 'req-96176f4d-0136-4e12-bb26-9e3583aca6aa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:41.683330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1284ae44c50a4e109184dac2041e050b', 'request_id': 'req-96176f4d-0136-4e12-bb26-9e3583aca6aa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:41.727524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1089/2186] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:41 2022] PUT /identity/v3/projects/94fc0363e64d4888a87ab4c5db85c7ea/users/a88a2d36a13a4cba8e389e4824fce252/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:41.731116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264f285-ce3f-4fbb-82ea-e7f9c50aba9b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:41.756015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] The token cache is being invalidate because project 1284ae44c50a4e109184dac2041e050b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:41.756462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:41.757475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:41.762288 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1098/2187] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:41 2022] DELETE /identity/v3/projects/1284ae44c50a4e109184dac2041e050b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:41.765037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:41.766688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:41.842053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264f285-ce3f-4fbb-82ea-e7f9c50aba9b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:41.848724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140d209-2e09-4580-881b-0c9675c00030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:41.851423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140d209-2e09-4580-881b-0c9675c00030 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:41.851423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140d209-2e09-4580-881b-0c9675c00030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:41.851423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140d209-2e09-4580-881b-0c9675c00030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.851930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140d209-2e09-4580-881b-0c9675c00030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:41.854192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140d209-2e09-4580-881b-0c9675c00030 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:41.872001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1090/2188] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:41.873202 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140d209-2e09-4580-881b-0c9675c00030 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:41.874928 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a140d209-2e09-4580-881b-0c9675c00030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:41.889418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96176f4d-0136-4e12-bb26-9e3583aca6aa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:41.890340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140d209-2e09-4580-881b-0c9675c00030 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:41.897953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:41.898749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5e28a-daba-45f2-9c87-99dbe74acd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:41.899168 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:41.899824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:41.899941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e28a-daba-45f2-9c87-99dbe74acd42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:41.900031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] PATH_INFO: `/v3/users/90777cfde8b24d74aef634e93d191945` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.900116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e28a-daba-45f2-9c87-99dbe74acd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:41.900559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e28a-daba-45f2-9c87-99dbe74acd42 admin admin] PATH_INFO: `/v3/projects/94fc0363e64d4888a87ab4c5db85c7ea/users/a88a2d36a13a4cba8e389e4824fce252/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.901857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=90777cfde8b24d74aef634e93d191945)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:41.903512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:41.904016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5e28a-daba-45f2-9c87-99dbe74acd42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94fc0363e64d4888a87ab4c5db85c7ea, user_id=a88a2d36a13a4cba8e389e4824fce252, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:41.906809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5e28a-daba-45f2-9c87-99dbe74acd42 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:41.921196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1091/2189] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:41 2022] PUT /identity/v3/projects/94fc0363e64d4888a87ab4c5db85c7ea/users/a88a2d36a13a4cba8e389e4824fce252/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:41.930927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2d23-4111-4a75-a35f-ce74e7c2b501 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:41.931400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2d23-4111-4a75-a35f-ce74e7c2b501 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:41.932979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf2d23-4111-4a75-a35f-ce74e7c2b501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:41.960658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-80cf2d23-4111-4a75-a35f-ce74e7c2b501 None None] MFA Rules not processed for user `a88a2d36a13a4cba8e389e4824fce252`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:41.961880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-80cf2d23-4111-4a75-a35f-ce74e7c2b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:42.032275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1092/2190] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:42.044135 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2d23-4111-4a75-a35f-ce74e7c2b501 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:42.045757 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-80cf2d23-4111-4a75-a35f-ce74e7c2b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:42.121075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf2d23-4111-4a75-a35f-ce74e7c2b501 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:42.126300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bcd1f-2c72-4bc2-8cb3-00d24e882b2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:42.126924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bcd1f-2c72-4bc2-8cb3-00d24e882b2d service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:42.127202 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bcd1f-2c72-4bc2-8cb3-00d24e882b2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:42.127475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bcd1f-2c72-4bc2-8cb3-00d24e882b2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:42.146605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bcd1f-2c72-4bc2-8cb3-00d24e882b2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:42.146605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bcd1f-2c72-4bc2-8cb3-00d24e882b2d service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:42.164072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90777cfde8b24d74aef634e93d191945'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:42.173207 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1093/2191] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:42.243836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:42.245125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90777cfde8b24d74aef634e93d191945'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:42.245823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90777cfde8b24d74aef634e93d191945'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:42.246422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90777cfde8b24d74aef634e93d191945'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:42.259853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90777cfde8b24d74aef634e93d191945'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:42.264892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bcd1f-2c72-4bc2-8cb3-00d24e882b2d service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:42.266311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-be3bcd1f-2c72-4bc2-8cb3-00d24e882b2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:42.273662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1099/2192] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:41 2022] DELETE /identity/v3/users/90777cfde8b24d74aef634e93d191945 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:42.282676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bcd1f-2c72-4bc2-8cb3-00d24e882b2d service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:42.376659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc584ee-2b0e-4fcd-b5ab-aaf63a06f12e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:42.377743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc584ee-2b0e-4fcd-b5ab-aaf63a06f12e service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:42.378176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc584ee-2b0e-4fcd-b5ab-aaf63a06f12e service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:42.378603 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc584ee-2b0e-4fcd-b5ab-aaf63a06f12e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:42.380816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1dc584ee-2b0e-4fcd-b5ab-aaf63a06f12e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:42.468492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc584ee-2b0e-4fcd-b5ab-aaf63a06f12e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:42.469973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc584ee-2b0e-4fcd-b5ab-aaf63a06f12e service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:42.493792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1094/2193] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:43.166509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:43.168168 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:43.270153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534548f2-6940-4f44-96f5-23a87b00f8fe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:43.275167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:43.276044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.276369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.276643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] PATH_INFO: `/v3/projects/fd48151f88a24a80ae1344e0d0b8cdd3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.277836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd48151f88a24a80ae1344e0d0b8cdd3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:43.279897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:43.430700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd48151f88a24a80ae1344e0d0b8cdd3', 'request_id': 'req-3cd35738-7f05-48bc-8503-2d5ee6b9f961'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.436999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd48151f88a24a80ae1344e0d0b8cdd3', 'request_id': 'req-3cd35738-7f05-48bc-8503-2d5ee6b9f961'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.446172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd48151f88a24a80ae1344e0d0b8cdd3', 'request_id': 'req-3cd35738-7f05-48bc-8503-2d5ee6b9f961'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.747709 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] The token cache is being invalidate because project fd48151f88a24a80ae1344e0d0b8cdd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:43.748030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.748657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3cd35738-7f05-48bc-8503-2d5ee6b9f961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:43.750209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1100/2194] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:43 2022] DELETE /identity/v3/projects/fd48151f88a24a80ae1344e0d0b8cdd3 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:43.756772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460f46-2ad9-4549-8625-1b723b73a7f7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.757648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460f46-2ad9-4549-8625-1b723b73a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.757648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460f46-2ad9-4549-8625-1b723b73a7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.784077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-47460f46-2ad9-4549-8625-1b723b73a7f7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:43.785446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-47460f46-2ad9-4549-8625-1b723b73a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:43.846433 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1095/2195] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:43.854914 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246f3cb-a5ca-4de4-a0ae-12397c350e34 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.855421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246f3cb-a5ca-4de4-a0ae-12397c350e34 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.855540 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246f3cb-a5ca-4de4-a0ae-12397c350e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.876377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a246f3cb-a5ca-4de4-a0ae-12397c350e34 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:43.877599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a246f3cb-a5ca-4de4-a0ae-12397c350e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:43.886702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1101/2196] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:43.891940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47460f46-2ad9-4549-8625-1b723b73a7f7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:43.902111 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47460f46-2ad9-4549-8625-1b723b73a7f7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:43.906981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b284ba-2f1e-4b81-8c03-7ec29dacf1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:43.907601 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b284ba-2f1e-4b81-8c03-7ec29dacf1da admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.907879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b284ba-2f1e-4b81-8c03-7ec29dacf1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.908226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b284ba-2f1e-4b81-8c03-7ec29dacf1da admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.909224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b284ba-2f1e-4b81-8c03-7ec29dacf1da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:43.909531 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b284ba-2f1e-4b81-8c03-7ec29dacf1da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:43.911201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b284ba-2f1e-4b81-8c03-7ec29dacf1da admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:43.924212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1096/2197] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:43.928643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246f3cb-a5ca-4de4-a0ae-12397c350e34 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:43.938693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246f3cb-a5ca-4de4-a0ae-12397c350e34 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:43.944018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93ea8c-1cc2-4f36-811c-f0dbfc5c7a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:43.944655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93ea8c-1cc2-4f36-811c-f0dbfc5c7a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:43.944965 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93ea8c-1cc2-4f36-811c-f0dbfc5c7a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:43.945269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93ea8c-1cc2-4f36-811c-f0dbfc5c7a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:43.945949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93ea8c-1cc2-4f36-811c-f0dbfc5c7a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:43.947943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93ea8c-1cc2-4f36-811c-f0dbfc5c7a26 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:44.246625 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1102/2198] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:43 2022] POST /identity/v3/projects => generated 387 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:44.251140 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b284ba-2f1e-4b81-8c03-7ec29dacf1da admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:44.262072 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b284ba-2f1e-4b81-8c03-7ec29dacf1da admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:44.338624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:44.352404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e0d9c-07ed-4133-bfa3-ec5b44d4c660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:44.353342 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e0d9c-07ed-4133-bfa3-ec5b44d4c660 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:44.353694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e0d9c-07ed-4133-bfa3-ec5b44d4c660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:44.354038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e0d9c-07ed-4133-bfa3-ec5b44d4c660 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:44.355325 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e0d9c-07ed-4133-bfa3-ec5b44d4c660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:44.357294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e0d9c-07ed-4133-bfa3-ec5b44d4c660 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:44.454801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1097/2199] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:44 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:44.456028 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93ea8c-1cc2-4f36-811c-f0dbfc5c7a26 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:44.466822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93ea8c-1cc2-4f36-811c-f0dbfc5c7a26 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:44.471706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f4b40-ea28-4825-a31f-daab61327148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:44.472319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4b40-ea28-4825-a31f-daab61327148 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:44.472601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4b40-ea28-4825-a31f-daab61327148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:44.472870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4b40-ea28-4825-a31f-daab61327148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:44.473609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f4b40-ea28-4825-a31f-daab61327148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:44.475209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f4b40-ea28-4825-a31f-daab61327148 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:44.486751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1103/2200] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:44.490742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e0d9c-07ed-4133-bfa3-ec5b44d4c660 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:44.506021 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e0d9c-07ed-4133-bfa3-ec5b44d4c660 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:44.509238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafeb94d-1b45-4399-a184-38ab01b51899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:44.509887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeb94d-1b45-4399-a184-38ab01b51899 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:44.510174 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeb94d-1b45-4399-a184-38ab01b51899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:44.510454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeb94d-1b45-4399-a184-38ab01b51899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:44.511164 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafeb94d-1b45-4399-a184-38ab01b51899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:44.512859 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafeb94d-1b45-4399-a184-38ab01b51899 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:44.524938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1098/2201] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:44.529441 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f4b40-ea28-4825-a31f-daab61327148 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:44.540433 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f4b40-ea28-4825-a31f-daab61327148 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:44.545093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331267dc-018f-4ccd-82e8-f5af6bdeedbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:44.545836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331267dc-018f-4ccd-82e8-f5af6bdeedbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:44.546180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331267dc-018f-4ccd-82e8-f5af6bdeedbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:44.546457 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331267dc-018f-4ccd-82e8-f5af6bdeedbd admin admin] PATH_INFO: `/v3/projects/67b80363131643d99e73527c594d3946/users/71722f90857441798c069972579272b4/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:44.568609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331267dc-018f-4ccd-82e8-f5af6bdeedbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b80363131643d99e73527c594d3946, user_id=71722f90857441798c069972579272b4, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:44.568822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331267dc-018f-4ccd-82e8-f5af6bdeedbd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:44.675052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1104/2202] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:44 2022] PUT /identity/v3/projects/67b80363131643d99e73527c594d3946/users/71722f90857441798c069972579272b4/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:44.686251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e037eb-d0f7-4e31-9139-c2e633872dad None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:44.686528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e037eb-d0f7-4e31-9139-c2e633872dad None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:44.686792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e037eb-d0f7-4e31-9139-c2e633872dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:44.716676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-81e037eb-d0f7-4e31-9139-c2e633872dad None None] MFA Rules not processed for user `71722f90857441798c069972579272b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:44.717955 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-81e037eb-d0f7-4e31-9139-c2e633872dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:44.787271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1099/2203] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:44.791983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331267dc-018f-4ccd-82e8-f5af6bdeedbd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:44.858416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331267dc-018f-4ccd-82e8-f5af6bdeedbd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:44.872182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a5733-cac2-486a-af8b-24527a83aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:44.872882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5733-cac2-486a-af8b-24527a83aabe admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:44.873264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5733-cac2-486a-af8b-24527a83aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:44.873600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5733-cac2-486a-af8b-24527a83aabe admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:44.874381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a5733-cac2-486a-af8b-24527a83aabe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:44.876722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a5733-cac2-486a-af8b-24527a83aabe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:44.977386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1105/2204] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:44 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:44.982993 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e037eb-d0f7-4e31-9139-c2e633872dad None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:44.994078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e037eb-d0f7-4e31-9139-c2e633872dad None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.053717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd707f5a-8103-4135-bc70-a63410d937e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.054561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd707f5a-8103-4135-bc70-a63410d937e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.054871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd707f5a-8103-4135-bc70-a63410d937e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.055148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd707f5a-8103-4135-bc70-a63410d937e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.055833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd707f5a-8103-4135-bc70-a63410d937e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.057795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd707f5a-8103-4135-bc70-a63410d937e4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.101581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:45.136691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1100/2205] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:44 2022] POST /identity/v3/users => generated 301 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:45.143887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a5733-cac2-486a-af8b-24527a83aabe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.156854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a5733-cac2-486a-af8b-24527a83aabe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.162288 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65f38c-5db0-4fa7-98f4-81c6ec605be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.169446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65f38c-5db0-4fa7-98f4-81c6ec605be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.169446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65f38c-5db0-4fa7-98f4-81c6ec605be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.169446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65f38c-5db0-4fa7-98f4-81c6ec605be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.169446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65f38c-5db0-4fa7-98f4-81c6ec605be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.169446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65f38c-5db0-4fa7-98f4-81c6ec605be2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.180865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1106/2206] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:45.182003 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd707f5a-8103-4135-bc70-a63410d937e4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.193379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd707f5a-8103-4135-bc70-a63410d937e4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.199043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bafff-5203-43d8-b13e-18daa7e1953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.199725 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bafff-5203-43d8-b13e-18daa7e1953d admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.202660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bafff-5203-43d8-b13e-18daa7e1953d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.202660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bafff-5203-43d8-b13e-18daa7e1953d admin admin] PATH_INFO: `/v3/projects/5334e204632e4134bf3dbbbed5602e77/users/e95c0de502914ac09a705f75eef9eb88/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.216635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bafff-5203-43d8-b13e-18daa7e1953d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5334e204632e4134bf3dbbbed5602e77, user_id=e95c0de502914ac09a705f75eef9eb88, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.219379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bafff-5203-43d8-b13e-18daa7e1953d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.292559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1101/2207] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:45 2022] PUT /identity/v3/projects/5334e204632e4134bf3dbbbed5602e77/users/e95c0de502914ac09a705f75eef9eb88/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:45.301271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65f38c-5db0-4fa7-98f4-81c6ec605be2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.309916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65f38c-5db0-4fa7-98f4-81c6ec605be2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.384390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0b446-67b7-4ace-a674-f4bd6c1ba932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.385326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0b446-67b7-4ace-a674-f4bd6c1ba932 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.385802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0b446-67b7-4ace-a674-f4bd6c1ba932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.386237 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0b446-67b7-4ace-a674-f4bd6c1ba932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.387205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0b446-67b7-4ace-a674-f4bd6c1ba932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.390555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0b446-67b7-4ace-a674-f4bd6c1ba932 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.404776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1107/2208] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:45.418051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bafff-5203-43d8-b13e-18daa7e1953d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.449073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bafff-5203-43d8-b13e-18daa7e1953d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.454912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da436276-907a-480c-be4c-d2ec6d871557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.456510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436276-907a-480c-be4c-d2ec6d871557 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.456796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436276-907a-480c-be4c-d2ec6d871557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.457441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da436276-907a-480c-be4c-d2ec6d871557 admin admin] PATH_INFO: `/v3/projects/5334e204632e4134bf3dbbbed5602e77/users/e95c0de502914ac09a705f75eef9eb88/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.460838 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da436276-907a-480c-be4c-d2ec6d871557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5334e204632e4134bf3dbbbed5602e77, user_id=e95c0de502914ac09a705f75eef9eb88, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.466619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da436276-907a-480c-be4c-d2ec6d871557 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.490667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1102/2209] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:45 2022] PUT /identity/v3/projects/5334e204632e4134bf3dbbbed5602e77/users/e95c0de502914ac09a705f75eef9eb88/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:45.511983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e0a5f-5076-42c5-8698-02561bbe8d4b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.512575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e0a5f-5076-42c5-8698-02561bbe8d4b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.512853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e0a5f-5076-42c5-8698-02561bbe8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.550466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d29e0a5f-5076-42c5-8698-02561bbe8d4b None None] MFA Rules not processed for user `e95c0de502914ac09a705f75eef9eb88`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:45.550466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d29e0a5f-5076-42c5-8698-02561bbe8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:45.630027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1108/2210] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:45.642570 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da436276-907a-480c-be4c-d2ec6d871557 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.644998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-da436276-907a-480c-be4c-d2ec6d871557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:45.705276 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da436276-907a-480c-be4c-d2ec6d871557 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.708963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba752c-1a23-40ef-813e-57d44151d697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.709631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba752c-1a23-40ef-813e-57d44151d697 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.709914 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba752c-1a23-40ef-813e-57d44151d697 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.710917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba752c-1a23-40ef-813e-57d44151d697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.720670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba752c-1a23-40ef-813e-57d44151d697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.722169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba752c-1a23-40ef-813e-57d44151d697 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:45.733116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1103/2211] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:45.876947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e0a5f-5076-42c5-8698-02561bbe8d4b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:45.945655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e0a5f-5076-42c5-8698-02561bbe8d4b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:45.950576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:45.951299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:45.951584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:45.951859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] PATH_INFO: `/v3/users/71722f90857441798c069972579272b4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:45.953206 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=71722f90857441798c069972579272b4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:45.955524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:46.169909 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71722f90857441798c069972579272b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:46.261861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71722f90857441798c069972579272b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:46.262634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71722f90857441798c069972579272b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:46.263665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71722f90857441798c069972579272b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:46.277615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71722f90857441798c069972579272b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:46.291738 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1109/2212] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:45 2022] DELETE /identity/v3/users/71722f90857441798c069972579272b4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:46.296127 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a553-4349-4191-a43c-c4baea6f2e2c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:46.296641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a553-4349-4191-a43c-c4baea6f2e2c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:46.296776 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a553-4349-4191-a43c-c4baea6f2e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:46.319006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2401a553-4349-4191-a43c-c4baea6f2e2c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:46.320553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2401a553-4349-4191-a43c-c4baea6f2e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:46.382564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1104/2213] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:46.392610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:46.394203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:46.459506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f99fa-22e8-4dfa-bff6-6cc47e9dff5b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:46.464220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce231c29-4aae-4bec-af38-082389c31589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:46.465093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231c29-4aae-4bec-af38-082389c31589 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:46.465412 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231c29-4aae-4bec-af38-082389c31589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:46.465690 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231c29-4aae-4bec-af38-082389c31589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:46.475462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce231c29-4aae-4bec-af38-082389c31589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:46.477118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce231c29-4aae-4bec-af38-082389c31589 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:46.487336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1110/2214] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:46.719530 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:46.995479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a553-4349-4191-a43c-c4baea6f2e2c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:46.996941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2401a553-4349-4191-a43c-c4baea6f2e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:47.010302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a553-4349-4191-a43c-c4baea6f2e2c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:47.015498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:47.016256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.016537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.016811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] PATH_INFO: `/v3/projects/67b80363131643d99e73527c594d3946` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.018018 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b80363131643d99e73527c594d3946)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:47.019929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:47.065872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce231c29-4aae-4bec-af38-082389c31589 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:47.065872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ce231c29-4aae-4bec-af38-082389c31589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:47.078608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce231c29-4aae-4bec-af38-082389c31589 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:47.083785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c009ae-bc33-4127-aef0-4f69be78f374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:47.084447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c009ae-bc33-4127-aef0-4f69be78f374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.084736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c009ae-bc33-4127-aef0-4f69be78f374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.085564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c009ae-bc33-4127-aef0-4f69be78f374 admin admin] PATH_INFO: `/v3/users/9af1e795619e4c20800625cedf6ab425` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.086881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c009ae-bc33-4127-aef0-4f69be78f374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af1e795619e4c20800625cedf6ab425)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:47.088823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c009ae-bc33-4127-aef0-4f69be78f374 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:47.181619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b80363131643d99e73527c594d3946', 'request_id': 'req-74ab289d-9eae-414c-8662-0888a33e5a0b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.187744 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b80363131643d99e73527c594d3946', 'request_id': 'req-74ab289d-9eae-414c-8662-0888a33e5a0b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.193672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b80363131643d99e73527c594d3946', 'request_id': 'req-74ab289d-9eae-414c-8662-0888a33e5a0b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.299804 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] The token cache is being invalidate because project 67b80363131643d99e73527c594d3946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:47.300439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.302478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.302478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1105/2215] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:46 2022] DELETE /identity/v3/projects/67b80363131643d99e73527c594d3946 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:47.306481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:47.307862 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:47.311374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01c009ae-bc33-4127-aef0-4f69be78f374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af1e795619e4c20800625cedf6ab425'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.371299 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab289d-9eae-414c-8662-0888a33e5a0b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:47.376153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:47.376587 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.376870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.377168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] PATH_INFO: `/v3/users/e95c0de502914ac09a705f75eef9eb88` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.378374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95c0de502914ac09a705f75eef9eb88)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:47.380322 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:47.393565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01c009ae-bc33-4127-aef0-4f69be78f374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af1e795619e4c20800625cedf6ab425'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.394635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01c009ae-bc33-4127-aef0-4f69be78f374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af1e795619e4c20800625cedf6ab425'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.395978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01c009ae-bc33-4127-aef0-4f69be78f374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af1e795619e4c20800625cedf6ab425'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.411249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01c009ae-bc33-4127-aef0-4f69be78f374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af1e795619e4c20800625cedf6ab425'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.424793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1111/2216] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:47 2022] DELETE /identity/v3/users/9af1e795619e4c20800625cedf6ab425 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:47.430586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0eee7-5149-4b3f-a538-d3c6edef15cb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.431097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0eee7-5149-4b3f-a538-d3c6edef15cb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.431422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0eee7-5149-4b3f-a538-d3c6edef15cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.453299 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-33a0eee7-5149-4b3f-a538-d3c6edef15cb None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:47.454776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-33a0eee7-5149-4b3f-a538-d3c6edef15cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:47.529522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1112/2217] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:47.537418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0eee7-5149-4b3f-a538-d3c6edef15cb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:47.539210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-33a0eee7-5149-4b3f-a538-d3c6edef15cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:47.580678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95c0de502914ac09a705f75eef9eb88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.582307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95c0de502914ac09a705f75eef9eb88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.605860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0eee7-5149-4b3f-a538-d3c6edef15cb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:47.611849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0ed38-3383-45af-8e89-e44e7b4e8da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:47.612472 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0ed38-3383-45af-8e89-e44e7b4e8da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:47.612846 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0ed38-3383-45af-8e89-e44e7b4e8da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:47.613120 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0ed38-3383-45af-8e89-e44e7b4e8da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:47.625559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0ed38-3383-45af-8e89-e44e7b4e8da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:47.627055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0ed38-3383-45af-8e89-e44e7b4e8da6 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:47.638920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1113/2218] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:47.713153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95c0de502914ac09a705f75eef9eb88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.714010 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95c0de502914ac09a705f75eef9eb88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.727246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95c0de502914ac09a705f75eef9eb88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:47.742681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:47.743443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1106/2219] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:47 2022] DELETE /identity/v3/users/e95c0de502914ac09a705f75eef9eb88 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:48.281995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0ed38-3383-45af-8e89-e44e7b4e8da6 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:48.289275 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-23e0ed38-3383-45af-8e89-e44e7b4e8da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:48.306342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0ed38-3383-45af-8e89-e44e7b4e8da6 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:48.311842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:48.313301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:48.387389 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:48.387990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:48.388269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:48.388541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] PATH_INFO: `/v3/projects/953b585fd5524365a26ff67d37c5c16a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:48.389746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=953b585fd5524365a26ff67d37c5c16a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:48.391813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:48.398107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0795827-df01-4ba0-9263-1a053088a394 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:48.404205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:48.407839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:48.407839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:48.407839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] PATH_INFO: `/v3/projects/5334e204632e4134bf3dbbbed5602e77` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:48.407839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5334e204632e4134bf3dbbbed5602e77)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:48.408973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:48.551031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5334e204632e4134bf3dbbbed5602e77', 'request_id': 'req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:48.551185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '953b585fd5524365a26ff67d37c5c16a', 'request_id': 'req-4c1be867-2788-496d-8be2-ba62568c97b7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:48.557731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5334e204632e4134bf3dbbbed5602e77', 'request_id': 'req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:48.560058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '953b585fd5524365a26ff67d37c5c16a', 'request_id': 'req-4c1be867-2788-496d-8be2-ba62568c97b7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:48.565330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5334e204632e4134bf3dbbbed5602e77', 'request_id': 'req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:48.566047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '953b585fd5524365a26ff67d37c5c16a', 'request_id': 'req-4c1be867-2788-496d-8be2-ba62568c97b7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:48.674677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] The token cache is being invalidate because project 5334e204632e4134bf3dbbbed5602e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:48.674917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:48.677229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-158b4fcd-069e-4a5c-a4bd-41a4639b6e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:48.679128 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1107/2220] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:48 2022] DELETE /identity/v3/projects/5334e204632e4134bf3dbbbed5602e77 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:48.683892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa1d42-86f6-4a99-9e03-fb12544cb452 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:48.684260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa1d42-86f6-4a99-9e03-fb12544cb452 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:48.684535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa1d42-86f6-4a99-9e03-fb12544cb452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:48.704106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-64fa1d42-86f6-4a99-9e03-fb12544cb452 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:48.705329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-64fa1d42-86f6-4a99-9e03-fb12544cb452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:48.733956 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] The token cache is being invalidate because project 953b585fd5524365a26ff67d37c5c16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:48.734254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:48.734950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:48.736517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1114/2221] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:48 2022] DELETE /identity/v3/projects/953b585fd5524365a26ff67d37c5c16a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:48.742084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:48.743513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:48.766008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1108/2222] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:48.774392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79feaa-1ae0-4fb6-b8c5-015b57396b64 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:48.774675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79feaa-1ae0-4fb6-b8c5-015b57396b64 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:48.775280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79feaa-1ae0-4fb6-b8c5-015b57396b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:48.795696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6d79feaa-1ae0-4fb6-b8c5-015b57396b64 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:48.796904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d79feaa-1ae0-4fb6-b8c5-015b57396b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:48.805643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1109/2223] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:48.809986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79feaa-1ae0-4fb6-b8c5-015b57396b64 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:48.817051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1be867-2788-496d-8be2-ba62568c97b7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:48.821397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79feaa-1ae0-4fb6-b8c5-015b57396b64 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:48.822148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:48.822802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:48.824129 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:48.824129 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] PATH_INFO: `/v3/users/1935c27f3d2a417b9b3f87a1a712e232` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:48.824476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1935c27f3d2a417b9b3f87a1a712e232)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:48.826454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:48.827105 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75362b4b-2f52-44db-ae80-a28a8fbe3307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:48.827718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362b4b-2f52-44db-ae80-a28a8fbe3307 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:48.827998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362b4b-2f52-44db-ae80-a28a8fbe3307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:48.828266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362b4b-2f52-44db-ae80-a28a8fbe3307 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:48.829032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75362b4b-2f52-44db-ae80-a28a8fbe3307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:48.829367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75362b4b-2f52-44db-ae80-a28a8fbe3307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:48.830947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75362b4b-2f52-44db-ae80-a28a8fbe3307 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:48.843330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1110/2224] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:39:48.850300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75362b4b-2f52-44db-ae80-a28a8fbe3307 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:48.863503 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75362b4b-2f52-44db-ae80-a28a8fbe3307 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:48.869162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6451a0-7a8f-4312-a787-68bc2bc662e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:48.869782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6451a0-7a8f-4312-a787-68bc2bc662e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:48.870150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6451a0-7a8f-4312-a787-68bc2bc662e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:48.870337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6451a0-7a8f-4312-a787-68bc2bc662e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:48.871002 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6451a0-7a8f-4312-a787-68bc2bc662e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:48.872985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6451a0-7a8f-4312-a787-68bc2bc662e8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:48.967142 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1111/2225] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:48 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:48.969430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6451a0-7a8f-4312-a787-68bc2bc662e8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:49.025665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1935c27f3d2a417b9b3f87a1a712e232'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.046129 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6451a0-7a8f-4312-a787-68bc2bc662e8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:49.050625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ebde1-82b8-49c6-abde-7d08bd2304d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:49.051305 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ebde1-82b8-49c6-abde-7d08bd2304d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:49.051736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ebde1-82b8-49c6-abde-7d08bd2304d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:49.052101 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ebde1-82b8-49c6-abde-7d08bd2304d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:49.053560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ebde1-82b8-49c6-abde-7d08bd2304d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:49.056614 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ebde1-82b8-49c6-abde-7d08bd2304d8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:49.090515 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1935c27f3d2a417b9b3f87a1a712e232'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.091447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1935c27f3d2a417b9b3f87a1a712e232'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.104105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1935c27f3d2a417b9b3f87a1a712e232'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.109699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1935c27f3d2a417b9b3f87a1a712e232'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.122467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1115/2226] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:48 2022] DELETE /identity/v3/users/1935c27f3d2a417b9b3f87a1a712e232 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:49.123294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:49.124765 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:49.196780 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be251eb0-ee85-434c-bf77-005748c40585 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:49.204819 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b68ec6-4931-443b-af85-5d1d4b5db169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:49.205555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68ec6-4931-443b-af85-5d1d4b5db169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:49.205792 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68ec6-4931-443b-af85-5d1d4b5db169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:49.206063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68ec6-4931-443b-af85-5d1d4b5db169 admin admin] PATH_INFO: `/v3/users/6e91fc978b9a45bf9708b5ab85f3d8eb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:49.207318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b68ec6-4931-443b-af85-5d1d4b5db169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e91fc978b9a45bf9708b5ab85f3d8eb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:49.209419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b68ec6-4931-443b-af85-5d1d4b5db169 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:49.220806 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1112/2227] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:48 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:39:49.223340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ebde1-82b8-49c6-abde-7d08bd2304d8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:49.228870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0d8ebde1-82b8-49c6-abde-7d08bd2304d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:49.250625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ebde1-82b8-49c6-abde-7d08bd2304d8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:49.255406 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc56b6b-cec8-4308-b027-ec204198ac46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:49.256030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc56b6b-cec8-4308-b027-ec204198ac46 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:49.256319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc56b6b-cec8-4308-b027-ec204198ac46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:49.256593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc56b6b-cec8-4308-b027-ec204198ac46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:49.257708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc56b6b-cec8-4308-b027-ec204198ac46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:49.259300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc56b6b-cec8-4308-b027-ec204198ac46 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:49.270947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1113/2228] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:49.274892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc56b6b-cec8-4308-b027-ec204198ac46 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:49.285072 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc56b6b-cec8-4308-b027-ec204198ac46 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:49.289894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460e191-c71f-4bcc-abf3-09b437550c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:49.290488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460e191-c71f-4bcc-abf3-09b437550c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:49.290795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460e191-c71f-4bcc-abf3-09b437550c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:49.291070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460e191-c71f-4bcc-abf3-09b437550c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:49.291760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460e191-c71f-4bcc-abf3-09b437550c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:49.293372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460e191-c71f-4bcc-abf3-09b437550c8f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:49.303248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1114/2229] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:39:49.315904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460e191-c71f-4bcc-abf3-09b437550c8f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:49.327034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460e191-c71f-4bcc-abf3-09b437550c8f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:49.332469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a1a3e-29b6-4805-ba66-db2a4c68b18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:49.333167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1a3e-29b6-4805-ba66-db2a4c68b18e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:49.333495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1a3e-29b6-4805-ba66-db2a4c68b18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:49.334157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1a3e-29b6-4805-ba66-db2a4c68b18e admin admin] PATH_INFO: `/v3/projects/7b020437fe94464db903f15e6fd46edc/users/3c335b357eda4f1b8d2a87b0cc859218/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:49.351289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a1a3e-29b6-4805-ba66-db2a4c68b18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b020437fe94464db903f15e6fd46edc, user_id=3c335b357eda4f1b8d2a87b0cc859218, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:49.354229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a1a3e-29b6-4805-ba66-db2a4c68b18e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:49.429532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34b68ec6-4931-443b-af85-5d1d4b5db169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e91fc978b9a45bf9708b5ab85f3d8eb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.448772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1115/2230] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:49 2022] PUT /identity/v3/projects/7b020437fe94464db903f15e6fd46edc/users/3c335b357eda4f1b8d2a87b0cc859218/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:49.461239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256b1ca-b041-4c25-9286-a34db9f8664f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:49.461533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256b1ca-b041-4c25-9286-a34db9f8664f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:49.465984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256b1ca-b041-4c25-9286-a34db9f8664f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:49.490309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9256b1ca-b041-4c25-9286-a34db9f8664f None None] MFA Rules not processed for user `3c335b357eda4f1b8d2a87b0cc859218`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:49.491555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9256b1ca-b041-4c25-9286-a34db9f8664f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:49.536685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34b68ec6-4931-443b-af85-5d1d4b5db169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e91fc978b9a45bf9708b5ab85f3d8eb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.540741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34b68ec6-4931-443b-af85-5d1d4b5db169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e91fc978b9a45bf9708b5ab85f3d8eb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.540741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34b68ec6-4931-443b-af85-5d1d4b5db169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e91fc978b9a45bf9708b5ab85f3d8eb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.552868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34b68ec6-4931-443b-af85-5d1d4b5db169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e91fc978b9a45bf9708b5ab85f3d8eb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.570336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1116/2231] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:49.576265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256b1ca-b041-4c25-9286-a34db9f8664f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:49.577852 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9256b1ca-b041-4c25-9286-a34db9f8664f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:49.578821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1116/2232] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:49 2022] DELETE /identity/v3/users/6e91fc978b9a45bf9708b5ab85f3d8eb => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:49.583766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af84f31-0b7e-4afa-8671-1a893c8a7b90 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:49.584236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af84f31-0b7e-4afa-8671-1a893c8a7b90 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:49.586171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af84f31-0b7e-4afa-8671-1a893c8a7b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:49.606150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9af84f31-0b7e-4afa-8671-1a893c8a7b90 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:49.607404 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9af84f31-0b7e-4afa-8671-1a893c8a7b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:49.651987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256b1ca-b041-4c25-9286-a34db9f8664f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:49.691456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1117/2233] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:49.692536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af84f31-0b7e-4afa-8671-1a893c8a7b90 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:49.695225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9af84f31-0b7e-4afa-8671-1a893c8a7b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:49.715653 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af84f31-0b7e-4afa-8671-1a893c8a7b90 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:49.721199 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:49.722039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:49.722344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c3592-47da-447c-9e68-f9f4b69ddbb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:49.722479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:49.722561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] PATH_INFO: `/v3/projects/98f30fda222d45a5ab2c3bbe22ec57d5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:49.723158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3592-47da-447c-9e68-f9f4b69ddbb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:49.723473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3592-47da-447c-9e68-f9f4b69ddbb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:49.723721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3592-47da-447c-9e68-f9f4b69ddbb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:49.723831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f30fda222d45a5ab2c3bbe22ec57d5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:49.726466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:49.785022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c3592-47da-447c-9e68-f9f4b69ddbb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:49.786560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c3592-47da-447c-9e68-f9f4b69ddbb7 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:49.796695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1117/2234] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:49.797520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c3592-47da-447c-9e68-f9f4b69ddbb7 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:49.798801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-475c3592-47da-447c-9e68-f9f4b69ddbb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:49.870743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c3592-47da-447c-9e68-f9f4b69ddbb7 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:49.871372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f30fda222d45a5ab2c3bbe22ec57d5', 'request_id': 'req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.878041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f30fda222d45a5ab2c3bbe22ec57d5', 'request_id': 'req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.883731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f30fda222d45a5ab2c3bbe22ec57d5', 'request_id': 'req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.923944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:49.928487 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20fd98-5eb5-478b-95fe-46e5871ff8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:49.929323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20fd98-5eb5-478b-95fe-46e5871ff8fa service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:49.929713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20fd98-5eb5-478b-95fe-46e5871ff8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:49.930264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20fd98-5eb5-478b-95fe-46e5871ff8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:49.971588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] The token cache is being invalidate because project 98f30fda222d45a5ab2c3bbe22ec57d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:49.972063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.972922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:49.974728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1118/2235] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:49 2022] DELETE /identity/v3/projects/98f30fda222d45a5ab2c3bbe22ec57d5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:49.976719 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:49.979981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:50.008879 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20fd98-5eb5-478b-95fe-46e5871ff8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:50.010977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20fd98-5eb5-478b-95fe-46e5871ff8fa service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:50.024838 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1118/2236] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:50.040084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20fd98-5eb5-478b-95fe-46e5871ff8fa service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:50.051459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20fd98-5eb5-478b-95fe-46e5871ff8fa service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:50.058710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11518d1-a689-4522-927b-c8c947b4f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:50.060431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11518d1-a689-4522-927b-c8c947b4f2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:50.060431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11518d1-a689-4522-927b-c8c947b4f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:50.060431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11518d1-a689-4522-927b-c8c947b4f2aa admin admin] PATH_INFO: `/v3/users/a88a2d36a13a4cba8e389e4824fce252` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:50.061882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11518d1-a689-4522-927b-c8c947b4f2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a88a2d36a13a4cba8e389e4824fce252)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:50.064115 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11518d1-a689-4522-927b-c8c947b4f2aa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:50.078966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9a9d0-aeba-4ffd-a30c-daa69b5a5f27 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:50.085029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:50.086040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:50.089117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:50.089117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] PATH_INFO: `/v3/users/3c335b357eda4f1b8d2a87b0cc859218` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:50.089117 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c335b357eda4f1b8d2a87b0cc859218)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:50.091904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:50.252898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f11518d1-a689-4522-927b-c8c947b4f2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a88a2d36a13a4cba8e389e4824fce252'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.253758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f11518d1-a689-4522-927b-c8c947b4f2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a88a2d36a13a4cba8e389e4824fce252'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.358037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f11518d1-a689-4522-927b-c8c947b4f2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a88a2d36a13a4cba8e389e4824fce252'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.364885 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f11518d1-a689-4522-927b-c8c947b4f2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a88a2d36a13a4cba8e389e4824fce252'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.365262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c335b357eda4f1b8d2a87b0cc859218'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.376289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f11518d1-a689-4522-927b-c8c947b4f2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a88a2d36a13a4cba8e389e4824fce252'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.396906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1119/2237] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:50 2022] DELETE /identity/v3/users/a88a2d36a13a4cba8e389e4824fce252 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:50.434422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c335b357eda4f1b8d2a87b0cc859218'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.435635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c335b357eda4f1b8d2a87b0cc859218'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.436293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c335b357eda4f1b8d2a87b0cc859218'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.463889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c335b357eda4f1b8d2a87b0cc859218'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.504655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1119/2238] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:39:49 2022] DELETE /identity/v3/users/3c335b357eda4f1b8d2a87b0cc859218 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:50.510951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0417-a99c-4b9d-90d2-8f72343f4eb1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:50.511451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0417-a99c-4b9d-90d2-8f72343f4eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:50.511732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0417-a99c-4b9d-90d2-8f72343f4eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:50.531934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-427d0417-a99c-4b9d-90d2-8f72343f4eb1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:50.533417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-427d0417-a99c-4b9d-90d2-8f72343f4eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:50.582044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:50.585452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:50.612273 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1120/2239] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:50.623153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0417-a99c-4b9d-90d2-8f72343f4eb1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:50.625265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-427d0417-a99c-4b9d-90d2-8f72343f4eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:50.668875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4e20b-90b0-4c80-b454-9871ab04e3cb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:50.673655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:50.674359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:50.674648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:50.674923 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] PATH_INFO: `/v3/projects/753406bcd5f843ceb39c79f8e96828d9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:50.676390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=753406bcd5f843ceb39c79f8e96828d9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:50.678453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:50.687533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0417-a99c-4b9d-90d2-8f72343f4eb1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:50.691353 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87cdf7-5fb6-4b44-8d8c-4b66c662ac16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:50.692108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87cdf7-5fb6-4b44-8d8c-4b66c662ac16 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:50.692468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87cdf7-5fb6-4b44-8d8c-4b66c662ac16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:50.692809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87cdf7-5fb6-4b44-8d8c-4b66c662ac16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:50.702407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87cdf7-5fb6-4b44-8d8c-4b66c662ac16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:50.703880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87cdf7-5fb6-4b44-8d8c-4b66c662ac16 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:50.716909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1121/2240] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:50.827728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '753406bcd5f843ceb39c79f8e96828d9', 'request_id': 'req-3db68911-9eb3-4e46-b8f8-ade16856f928'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.834216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '753406bcd5f843ceb39c79f8e96828d9', 'request_id': 'req-3db68911-9eb3-4e46-b8f8-ade16856f928'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.840919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '753406bcd5f843ceb39c79f8e96828d9', 'request_id': 'req-3db68911-9eb3-4e46-b8f8-ade16856f928'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.935032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] The token cache is being invalidate because project 753406bcd5f843ceb39c79f8e96828d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:50.935032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.935032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:50.935032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1120/2241] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:50 2022] DELETE /identity/v3/projects/753406bcd5f843ceb39c79f8e96828d9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:50.939496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e74a-4599-4228-a094-38fe9817f602 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:50.939789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e74a-4599-4228-a094-38fe9817f602 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:50.940067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e74a-4599-4228-a094-38fe9817f602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:50.963146 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4e30e74a-4599-4228-a094-38fe9817f602 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:50.964428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4e30e74a-4599-4228-a094-38fe9817f602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:50.997074 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.003312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.040925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1122/2242] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:51.048596 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3b462-3ab5-4a73-ba70-43715633a8b1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.048994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3b462-3ab5-4a73-ba70-43715633a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.049359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3b462-3ab5-4a73-ba70-43715633a8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.076760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:51.078441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-18e3b462-3ab5-4a73-ba70-43715633a8b1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:51.079763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-18e3b462-3ab5-4a73-ba70-43715633a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.091314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1123/2243] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:51.096149 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3b462-3ab5-4a73-ba70-43715633a8b1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.107419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3b462-3ab5-4a73-ba70-43715633a8b1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.113568 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dcd6b-38b7-4e52-a820-848a1dc4069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.114227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dcd6b-38b7-4e52-a820-848a1dc4069e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.114512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dcd6b-38b7-4e52-a820-848a1dc4069e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.114801 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dcd6b-38b7-4e52-a820-848a1dc4069e admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.115507 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dcd6b-38b7-4e52-a820-848a1dc4069e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:51.115797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dcd6b-38b7-4e52-a820-848a1dc4069e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.118451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dcd6b-38b7-4e52-a820-848a1dc4069e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.120667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db68911-9eb3-4e46-b8f8-ade16856f928 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.126076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.126787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.127058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.127509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] PATH_INFO: `/v3/projects/94fc0363e64d4888a87ab4c5db85c7ea` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.128941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94fc0363e64d4888a87ab4c5db85c7ea)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.131262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.137381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1124/2244] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:51.138414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dcd6b-38b7-4e52-a820-848a1dc4069e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.150657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dcd6b-38b7-4e52-a820-848a1dc4069e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.156207 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eebe49-d620-4752-82d6-625c851c49da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.156836 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eebe49-d620-4752-82d6-625c851c49da admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.157296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eebe49-d620-4752-82d6-625c851c49da admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.157604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eebe49-d620-4752-82d6-625c851c49da admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.158520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eebe49-d620-4752-82d6-625c851c49da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.160436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eebe49-d620-4752-82d6-625c851c49da admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.236493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94fc0363e64d4888a87ab4c5db85c7ea', 'request_id': 'req-01c060d3-8283-47e1-957f-0202f97be432'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.248380 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94fc0363e64d4888a87ab4c5db85c7ea', 'request_id': 'req-01c060d3-8283-47e1-957f-0202f97be432'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.251143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94fc0363e64d4888a87ab4c5db85c7ea', 'request_id': 'req-01c060d3-8283-47e1-957f-0202f97be432'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.274869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1125/2245] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:51 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:51.275679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eebe49-d620-4752-82d6-625c851c49da admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.284108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-82eebe49-d620-4752-82d6-625c851c49da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.349952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eebe49-d620-4752-82d6-625c851c49da admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.359350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] The token cache is being invalidate because project 94fc0363e64d4888a87ab4c5db85c7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:51.359660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.360338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.362110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.362737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1121/2246] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:50 2022] DELETE /identity/v3/projects/94fc0363e64d4888a87ab4c5db85c7ea => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:39:51.368336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.368465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.368559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.368559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] PATH_INFO: `/v3/projects/7b020437fe94464db903f15e6fd46edc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.368907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.369008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b020437fe94464db903f15e6fd46edc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.369008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.438964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c060d3-8283-47e1-957f-0202f97be432 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.444256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c141b2-e7b3-48ae-be0d-d8e798056b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.445318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c141b2-e7b3-48ae-be0d-d8e798056b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.445750 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c141b2-e7b3-48ae-be0d-d8e798056b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.446210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c141b2-e7b3-48ae-be0d-d8e798056b07 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.447127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c141b2-e7b3-48ae-be0d-d8e798056b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.449992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c141b2-e7b3-48ae-be0d-d8e798056b07 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.501405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b020437fe94464db903f15e6fd46edc', 'request_id': 'req-55e080a3-f912-4c79-a569-a7e3070bd28b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.507562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b020437fe94464db903f15e6fd46edc', 'request_id': 'req-55e080a3-f912-4c79-a569-a7e3070bd28b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.513947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b020437fe94464db903f15e6fd46edc', 'request_id': 'req-55e080a3-f912-4c79-a569-a7e3070bd28b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.582493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1122/2247] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:51 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:51.583776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb624e1-da7f-4883-85b7-dbcd84d3080a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.584061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb624e1-da7f-4883-85b7-dbcd84d3080a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.584334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb624e1-da7f-4883-85b7-dbcd84d3080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.606399 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0bb624e1-da7f-4883-85b7-dbcd84d3080a None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:51.607786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0bb624e1-da7f-4883-85b7-dbcd84d3080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.638756 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] The token cache is being invalidate because project 7b020437fe94464db903f15e6fd46edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:39:51.643732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.643732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:39:51.645253 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1126/2248] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:39:51 2022] DELETE /identity/v3/projects/7b020437fe94464db903f15e6fd46edc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:51.646487 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.652141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.679566 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1123/2249] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:51.680894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef1206-0854-467e-8bfd-16b43b07e2d4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.681223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef1206-0854-467e-8bfd-16b43b07e2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.681493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef1206-0854-467e-8bfd-16b43b07e2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.719614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1eef1206-0854-467e-8bfd-16b43b07e2d4 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:51.721125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1eef1206-0854-467e-8bfd-16b43b07e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.733220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1124/2250] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:51.735133 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e080a3-f912-4c79-a569-a7e3070bd28b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.735443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e7bd4-b4f4-43b9-8912-92413a84aa65 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.735880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e7bd4-b4f4-43b9-8912-92413a84aa65 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.736153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e7bd4-b4f4-43b9-8912-92413a84aa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.745599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5c58-5b6f-4ec1-8ff3-a3c408c7eccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.746361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5c58-5b6f-4ec1-8ff3-a3c408c7eccb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.746650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5c58-5b6f-4ec1-8ff3-a3c408c7eccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.747020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5c58-5b6f-4ec1-8ff3-a3c408c7eccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.747750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa5c58-5b6f-4ec1-8ff3-a3c408c7eccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.749630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa5c58-5b6f-4ec1-8ff3-a3c408c7eccb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.767700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1127/2251] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:51.767700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e48075-0ce8-4a1f-9f36-beb9b3fc9ab9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.767700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e48075-0ce8-4a1f-9f36-beb9b3fc9ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.767700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e48075-0ce8-4a1f-9f36-beb9b3fc9ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.768154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-344e7bd4-b4f4-43b9-8912-92413a84aa65 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:51.769984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-344e7bd4-b4f4-43b9-8912-92413a84aa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.785502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c3e48075-0ce8-4a1f-9f36-beb9b3fc9ab9 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:51.786718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3e48075-0ce8-4a1f-9f36-beb9b3fc9ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:51.796128 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1128/2252] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:51.796858 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e48075-0ce8-4a1f-9f36-beb9b3fc9ab9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.802516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1125/2253] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:51.807604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e7bd4-b4f4-43b9-8912-92413a84aa65 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.809503 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e48075-0ce8-4a1f-9f36-beb9b3fc9ab9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.816471 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:51.817591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f5da-3813-4957-b23e-5c21261840f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.818606 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f5da-3813-4957-b23e-5c21261840f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.822431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f5da-3813-4957-b23e-5c21261840f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.822844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71f5da-3813-4957-b23e-5c21261840f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.824200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71f5da-3813-4957-b23e-5c21261840f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.826084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e7bd4-b4f4-43b9-8912-92413a84aa65 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.826921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71f5da-3813-4957-b23e-5c21261840f2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.831628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253933-17f8-4b0c-a0a3-543806174fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.833978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253933-17f8-4b0c-a0a3-543806174fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.833978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253933-17f8-4b0c-a0a3-543806174fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.833978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253933-17f8-4b0c-a0a3-543806174fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.833978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253933-17f8-4b0c-a0a3-543806174fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:51.834815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253933-17f8-4b0c-a0a3-543806174fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.841750 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253933-17f8-4b0c-a0a3-543806174fe3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.845778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1129/2254] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:51.845778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f5da-3813-4957-b23e-5c21261840f2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.859107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71f5da-3813-4957-b23e-5c21261840f2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.860212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1126/2255] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:51.862776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253933-17f8-4b0c-a0a3-543806174fe3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.867504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe26840-b5b2-4e91-b924-00d6c543a0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.868385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe26840-b5b2-4e91-b924-00d6c543a0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.868768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe26840-b5b2-4e91-b924-00d6c543a0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.869167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe26840-b5b2-4e91-b924-00d6c543a0bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.870012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe26840-b5b2-4e91-b924-00d6c543a0bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:39:51.870415 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe26840-b5b2-4e91-b924-00d6c543a0bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.872935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe26840-b5b2-4e91-b924-00d6c543a0bb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.878187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253933-17f8-4b0c-a0a3-543806174fe3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.886245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7885d6-92f2-421c-bd1e-07023f9f7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.887189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7885d6-92f2-421c-bd1e-07023f9f7333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.895340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7885d6-92f2-421c-bd1e-07023f9f7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.895340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7885d6-92f2-421c-bd1e-07023f9f7333 admin admin] PATH_INFO: `/v3/projects/b2a855302f2f40a3b5d5e1a9ae6e91bf/users/d19a72ed2e9040c6a8463a63e42f3d61/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.895577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1130/2256] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:39:51.895577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe26840-b5b2-4e91-b924-00d6c543a0bb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:51.907323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe26840-b5b2-4e91-b924-00d6c543a0bb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:51.915148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d62b6-5144-41bb-b2b8-939be80232f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:51.915794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d62b6-5144-41bb-b2b8-939be80232f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:51.916252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d62b6-5144-41bb-b2b8-939be80232f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:51.916547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d62b6-5144-41bb-b2b8-939be80232f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:51.917817 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d62b6-5144-41bb-b2b8-939be80232f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.918605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7885d6-92f2-421c-bd1e-07023f9f7333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a855302f2f40a3b5d5e1a9ae6e91bf, user_id=d19a72ed2e9040c6a8463a63e42f3d61, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:51.919876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d62b6-5144-41bb-b2b8-939be80232f7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:51.925711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7885d6-92f2-421c-bd1e-07023f9f7333 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.004791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1127/2257] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:51 2022] PUT /identity/v3/projects/b2a855302f2f40a3b5d5e1a9ae6e91bf/users/d19a72ed2e9040c6a8463a63e42f3d61/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:52.005683 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7885d6-92f2-421c-bd1e-07023f9f7333 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.040752 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1131/2258] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:51 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:52.042337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535ab6-8cb3-426f-9c1c-f7251ac190ad None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.042628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535ab6-8cb3-426f-9c1c-f7251ac190ad None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.042907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535ab6-8cb3-426f-9c1c-f7251ac190ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.071449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-60535ab6-8cb3-426f-9c1c-f7251ac190ad None None] MFA Rules not processed for user `d19a72ed2e9040c6a8463a63e42f3d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:52.072660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60535ab6-8cb3-426f-9c1c-f7251ac190ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:52.074230 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7885d6-92f2-421c-bd1e-07023f9f7333 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.130915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf6f25-43f0-4558-aa09-cf343027e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.131534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf6f25-43f0-4558-aa09-cf343027e882 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.132417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf6f25-43f0-4558-aa09-cf343027e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.132685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf6f25-43f0-4558-aa09-cf343027e882 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.133376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf6f25-43f0-4558-aa09-cf343027e882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.135280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf6f25-43f0-4558-aa09-cf343027e882 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.147758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1132/2259] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:52.148683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60535ab6-8cb3-426f-9c1c-f7251ac190ad None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.159727 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60535ab6-8cb3-426f-9c1c-f7251ac190ad None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.166262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaf67c-0f51-4848-b6b2-6162264e9987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.166986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf67c-0f51-4848-b6b2-6162264e9987 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.173029 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf67c-0f51-4848-b6b2-6162264e9987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.173029 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf67c-0f51-4848-b6b2-6162264e9987 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.173029 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaf67c-0f51-4848-b6b2-6162264e9987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.173029 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaf67c-0f51-4848-b6b2-6162264e9987 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.255697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1128/2260] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:39:52 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:52.255697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf6f25-43f0-4558-aa09-cf343027e882 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.258884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bcdf6f25-43f0-4558-aa09-cf343027e882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:52.269015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1133/2261] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:52 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:52.269932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaf67c-0f51-4848-b6b2-6162264e9987 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.280005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaf67c-0f51-4848-b6b2-6162264e9987 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.340513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf6f25-43f0-4558-aa09-cf343027e882 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.344471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cf391-44e6-492c-bee1-862c5de64911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.345300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf391-44e6-492c-bee1-862c5de64911 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.345614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf391-44e6-492c-bee1-862c5de64911 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.345850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf391-44e6-492c-bee1-862c5de64911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.369112 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4207d4c-1a39-4cb0-99f9-318e61af5782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.371376 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207d4c-1a39-4cb0-99f9-318e61af5782 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.371376 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207d4c-1a39-4cb0-99f9-318e61af5782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.371376 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207d4c-1a39-4cb0-99f9-318e61af5782 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.371376 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4207d4c-1a39-4cb0-99f9-318e61af5782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.373080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4207d4c-1a39-4cb0-99f9-318e61af5782 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.393265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:52.420551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cf391-44e6-492c-bee1-862c5de64911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.422033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cf391-44e6-492c-bee1-862c5de64911 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.433969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1129/2262] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:52.435428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cf391-44e6-492c-bee1-862c5de64911 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.452101 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1134/2263] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:39:52 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:39:52.452540 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cf391-44e6-492c-bee1-862c5de64911 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.455005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4207d4c-1a39-4cb0-99f9-318e61af5782 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.458536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb56a8-cec7-4fd3-bbc8-438ad035ac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.459249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb56a8-cec7-4fd3-bbc8-438ad035ac34 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.459606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb56a8-cec7-4fd3-bbc8-438ad035ac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.460696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb56a8-cec7-4fd3-bbc8-438ad035ac34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.461517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb56a8-cec7-4fd3-bbc8-438ad035ac34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.463356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb56a8-cec7-4fd3-bbc8-438ad035ac34 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.468857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4207d4c-1a39-4cb0-99f9-318e61af5782 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.474073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0807c-4a70-4821-bb3c-4403bb85141a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.474789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0807c-4a70-4821-bb3c-4403bb85141a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.475141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0807c-4a70-4821-bb3c-4403bb85141a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.476152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1130/2264] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:52.476271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0807c-4a70-4821-bb3c-4403bb85141a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.479948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0807c-4a70-4821-bb3c-4403bb85141a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.481727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb56a8-cec7-4fd3-bbc8-438ad035ac34 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.482032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0807c-4a70-4821-bb3c-4403bb85141a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.518766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb56a8-cec7-4fd3-bbc8-438ad035ac34 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.519793 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1135/2265] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:52.523722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0807c-4a70-4821-bb3c-4403bb85141a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.528401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c054ca-2bf9-439c-aa4c-984350e53393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.529290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c054ca-2bf9-439c-aa4c-984350e53393 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.530218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c054ca-2bf9-439c-aa4c-984350e53393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.530567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c054ca-2bf9-439c-aa4c-984350e53393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.531440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c054ca-2bf9-439c-aa4c-984350e53393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.534350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c054ca-2bf9-439c-aa4c-984350e53393 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.538697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0807c-4a70-4821-bb3c-4403bb85141a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.544844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1fe50-bf8b-460a-91ce-c2078a2225de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.545536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1fe50-bf8b-460a-91ce-c2078a2225de admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.545896 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1fe50-bf8b-460a-91ce-c2078a2225de admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.546337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1fe50-bf8b-460a-91ce-c2078a2225de admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.547330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1fe50-bf8b-460a-91ce-c2078a2225de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.550037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1fe50-bf8b-460a-91ce-c2078a2225de admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.563647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1131/2266] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:52.568508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c054ca-2bf9-439c-aa4c-984350e53393 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.568664 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1136/2267] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:39:52.574487 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1fe50-bf8b-460a-91ce-c2078a2225de admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.588606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c054ca-2bf9-439c-aa4c-984350e53393 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.593430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1fe50-bf8b-460a-91ce-c2078a2225de admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.596116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e67de-6349-4d20-8124-2f9249911232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.596895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e67de-6349-4d20-8124-2f9249911232 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.597365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e67de-6349-4d20-8124-2f9249911232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.597635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e67de-6349-4d20-8124-2f9249911232 admin admin] PATH_INFO: `/v3/projects/0d2a592551b14f5e9aba8b2974fed653/users/7a25b8fdc0bd44df8cb730ccc07de16e/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.603970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91d585-02f6-448e-87da-f2edd101a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.605878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91d585-02f6-448e-87da-f2edd101a623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.609605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91d585-02f6-448e-87da-f2edd101a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.611517 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91d585-02f6-448e-87da-f2edd101a623 admin admin] PATH_INFO: `/v3/projects/290d8bf182a246c48333e87be72cff85/users/f983ef89a788487dad748e743d4e30ba/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.617825 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e67de-6349-4d20-8124-2f9249911232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2a592551b14f5e9aba8b2974fed653, user_id=7a25b8fdc0bd44df8cb730ccc07de16e, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.620818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e67de-6349-4d20-8124-2f9249911232 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.638508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91d585-02f6-448e-87da-f2edd101a623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290d8bf182a246c48333e87be72cff85, user_id=f983ef89a788487dad748e743d4e30ba, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:52.641059 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91d585-02f6-448e-87da-f2edd101a623 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:52.718244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1132/2268] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:52 2022] PUT /identity/v3/projects/0d2a592551b14f5e9aba8b2974fed653/users/7a25b8fdc0bd44df8cb730ccc07de16e/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:52.733201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1279e4-08ff-429b-8d1e-2d0688eb9067 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.733489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1279e4-08ff-429b-8d1e-2d0688eb9067 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.733757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1279e4-08ff-429b-8d1e-2d0688eb9067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.757420 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1137/2269] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:39:52 2022] PUT /identity/v3/projects/290d8bf182a246c48333e87be72cff85/users/f983ef89a788487dad748e743d4e30ba/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:39:52.768735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e925e5-7018-4387-87d6-79515df5a238 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.769022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e925e5-7018-4387-87d6-79515df5a238 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.769339 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e925e5-7018-4387-87d6-79515df5a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:52.773247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ae1279e4-08ff-429b-8d1e-2d0688eb9067 None None] MFA Rules not processed for user `7a25b8fdc0bd44df8cb730ccc07de16e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:52.774565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae1279e4-08ff-429b-8d1e-2d0688eb9067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:52.812242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-83e925e5-7018-4387-87d6-79515df5a238 None None] MFA Rules not processed for user `f983ef89a788487dad748e743d4e30ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:52.813683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-83e925e5-7018-4387-87d6-79515df5a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:52.892502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1133/2270] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:52.896710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1279e4-08ff-429b-8d1e-2d0688eb9067 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:52.904733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae1279e4-08ff-429b-8d1e-2d0688eb9067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:52.917289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1138/2271] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:39:52.986720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1279e4-08ff-429b-8d1e-2d0688eb9067 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:52.990851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b25e0-7dbd-4764-9322-6f290682bf96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:52.992486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b25e0-7dbd-4764-9322-6f290682bf96 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:52.992786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b25e0-7dbd-4764-9322-6f290682bf96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:52.993414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b25e0-7dbd-4764-9322-6f290682bf96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:53.011274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b25e0-7dbd-4764-9322-6f290682bf96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:53.016982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b25e0-7dbd-4764-9322-6f290682bf96 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:53.030786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1134/2272] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:39:53.169869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:53.251551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e925e5-7018-4387-87d6-79515df5a238 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:39:53.274371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e925e5-7018-4387-87d6-79515df5a238 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:39:53.282674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f4deb-c791-4edb-9d42-21a49bb42b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:39:53.285938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f4deb-c791-4edb-9d42-21a49bb42b24 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:53.286227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f4deb-c791-4edb-9d42-21a49bb42b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:53.286511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f4deb-c791-4edb-9d42-21a49bb42b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:53.304387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f4deb-c791-4edb-9d42-21a49bb42b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:39:53.305823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f4deb-c791-4edb-9d42-21a49bb42b24 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:39:53.332886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1139/2273] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:39:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:39:54.478696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:54.530043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:55.003313 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504520a-054b-4a04-8b7d-1e87ad5d6760 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:55.003591 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504520a-054b-4a04-8b7d-1e87ad5d6760 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:55.003889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504520a-054b-4a04-8b7d-1e87ad5d6760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:55.027294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d504520a-054b-4a04-8b7d-1e87ad5d6760 None None] MFA Rules not processed for user `d19a72ed2e9040c6a8463a63e42f3d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:55.028212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d504520a-054b-4a04-8b7d-1e87ad5d6760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:55.091298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1135/2274] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:55.225246 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:56.066738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d091-2aa6-4fe9-8318-ee3e9ef7304d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:39:56.067685 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d091-2aa6-4fe9-8318-ee3e9ef7304d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:39:56.068561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d091-2aa6-4fe9-8318-ee3e9ef7304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:39:56.089622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7472d091-2aa6-4fe9-8318-ee3e9ef7304d None None] MFA Rules not processed for user `e728ae311b604bbcaf41f91562bffbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:39:56.090831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7472d091-2aa6-4fe9-8318-ee3e9ef7304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:39:56.152538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1140/2275] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:39:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:39:56.438953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:56.494599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:58.340421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:39:58.987400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:00.513102 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:00.749061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfba051-485b-4278-90fb-090b14394051 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.749722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfba051-485b-4278-90fb-090b14394051 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.750001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfba051-485b-4278-90fb-090b14394051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.770553 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9bfba051-485b-4278-90fb-090b14394051 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:00.771757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9bfba051-485b-4278-90fb-090b14394051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:00.830576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d091-2aa6-4fe9-8318-ee3e9ef7304d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:00.865485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1136/2276] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:00.913510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d091-2aa6-4fe9-8318-ee3e9ef7304d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:00.916969 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:00.917654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:00.917784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfba051-485b-4278-90fb-090b14394051 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:00.918395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:00.918989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] PATH_INFO: `/v3/users/7a25b8fdc0bd44df8cb730ccc07de16e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:00.919115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9bfba051-485b-4278-90fb-090b14394051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:00.920536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a25b8fdc0bd44df8cb730ccc07de16e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:00.923003 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:01.033416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:01.055539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfba051-485b-4278-90fb-090b14394051 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:01.061066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210d4a2-716c-4aa4-a5ce-6072420fcb54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:01.061708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210d4a2-716c-4aa4-a5ce-6072420fcb54 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:01.065381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210d4a2-716c-4aa4-a5ce-6072420fcb54 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:01.065749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210d4a2-716c-4aa4-a5ce-6072420fcb54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:01.077638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210d4a2-716c-4aa4-a5ce-6072420fcb54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:01.079346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210d4a2-716c-4aa4-a5ce-6072420fcb54 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:01.091429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1137/2277] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 05:40:01.212572 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a25b8fdc0bd44df8cb730ccc07de16e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:01.214081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a25b8fdc0bd44df8cb730ccc07de16e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:01.289871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a25b8fdc0bd44df8cb730ccc07de16e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:01.293210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a25b8fdc0bd44df8cb730ccc07de16e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:01.330707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a25b8fdc0bd44df8cb730ccc07de16e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:01.356882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1141/2278] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:00 2022] DELETE /identity/v3/users/7a25b8fdc0bd44df8cb730ccc07de16e => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:01.361782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e614f-6375-44e2-8d61-2dfb8873bec1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:01.362123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e614f-6375-44e2-8d61-2dfb8873bec1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:01.362341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e614f-6375-44e2-8d61-2dfb8873bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:01.393360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7d6e614f-6375-44e2-8d61-2dfb8873bec1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:01.394575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7d6e614f-6375-44e2-8d61-2dfb8873bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:01.555860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1138/2279] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:01.573648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:01.573648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:01.785624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842cb0f-6a47-4fd4-afee-d4aa9e233a68 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:01.795264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da008cd5-1954-4908-b86a-084aee6c2278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:01.795681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da008cd5-1954-4908-b86a-084aee6c2278 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:01.795975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da008cd5-1954-4908-b86a-084aee6c2278 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:01.796267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da008cd5-1954-4908-b86a-084aee6c2278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:01.820519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da008cd5-1954-4908-b86a-084aee6c2278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:01.822155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da008cd5-1954-4908-b86a-084aee6c2278 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:01.833392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:01.891083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1142/2280] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:02.822076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:03.421203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e614f-6375-44e2-8d61-2dfb8873bec1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:03.422737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7d6e614f-6375-44e2-8d61-2dfb8873bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:03.443565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e614f-6375-44e2-8d61-2dfb8873bec1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:03.465535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:03.465843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:03.466129 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:03.467036 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] PATH_INFO: `/v3/projects/0d2a592551b14f5e9aba8b2974fed653` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:03.472007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2a592551b14f5e9aba8b2974fed653)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:03.474272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:03.683106 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2a592551b14f5e9aba8b2974fed653', 'request_id': 'req-b562209c-5c32-4c38-ba2e-ca277392a399'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:03.698648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2a592551b14f5e9aba8b2974fed653', 'request_id': 'req-b562209c-5c32-4c38-ba2e-ca277392a399'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:03.722582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2a592551b14f5e9aba8b2974fed653', 'request_id': 'req-b562209c-5c32-4c38-ba2e-ca277392a399'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:03.797090 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] The token cache is being invalidate because project 0d2a592551b14f5e9aba8b2974fed653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:03.797641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:03.798595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b562209c-5c32-4c38-ba2e-ca277392a399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:03.801435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1139/2281] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:03 2022] DELETE /identity/v3/projects/0d2a592551b14f5e9aba8b2974fed653 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:03.806925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dfa1d-a86f-4f50-9d18-2e0be1fd8c52 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:03.807458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dfa1d-a86f-4f50-9d18-2e0be1fd8c52 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:03.807458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dfa1d-a86f-4f50-9d18-2e0be1fd8c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:03.856360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d25dfa1d-a86f-4f50-9d18-2e0be1fd8c52 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:03.858126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d25dfa1d-a86f-4f50-9d18-2e0be1fd8c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:03.981963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1143/2282] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:03.992550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a4eda-c34d-4b57-bd18-bb91f1d4252f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:03.992838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a4eda-c34d-4b57-bd18-bb91f1d4252f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:03.993115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a4eda-c34d-4b57-bd18-bb91f1d4252f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:04.030231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b10a4eda-c34d-4b57-bd18-bb91f1d4252f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:04.031511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b10a4eda-c34d-4b57-bd18-bb91f1d4252f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:04.061922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1140/2283] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:04.062143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dfa1d-a86f-4f50-9d18-2e0be1fd8c52 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:04.079808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:04.084386 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dfa1d-a86f-4f50-9d18-2e0be1fd8c52 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:04.097251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c45cca-6adf-4105-b179-279de33d71d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:04.097892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c45cca-6adf-4105-b179-279de33d71d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:04.098167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c45cca-6adf-4105-b179-279de33d71d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:04.098440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c45cca-6adf-4105-b179-279de33d71d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:04.099197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c45cca-6adf-4105-b179-279de33d71d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:40:04.099494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c45cca-6adf-4105-b179-279de33d71d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:04.101441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c45cca-6adf-4105-b179-279de33d71d7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:04.144927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1144/2284] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:40:04.148456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a4eda-c34d-4b57-bd18-bb91f1d4252f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:04.181116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a4eda-c34d-4b57-bd18-bb91f1d4252f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:04.200661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaea99-8602-40de-8422-fc4dd3b6d322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:04.203598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaea99-8602-40de-8422-fc4dd3b6d322 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:04.203884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaea99-8602-40de-8422-fc4dd3b6d322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:04.204162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaea99-8602-40de-8422-fc4dd3b6d322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:04.204869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaea99-8602-40de-8422-fc4dd3b6d322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:04.206873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaea99-8602-40de-8422-fc4dd3b6d322 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:04.255608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:04.365188 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1141/2285] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:04 2022] POST /identity/v3/projects => generated 369 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:04.369470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c45cca-6adf-4105-b179-279de33d71d7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:04.394555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c45cca-6adf-4105-b179-279de33d71d7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:04.587947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710777b-724d-4049-b027-218d7a49e8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:04.588599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710777b-724d-4049-b027-218d7a49e8ee admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:04.589321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710777b-724d-4049-b027-218d7a49e8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:04.589321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710777b-724d-4049-b027-218d7a49e8ee admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:04.589858 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710777b-724d-4049-b027-218d7a49e8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:04.591824 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710777b-724d-4049-b027-218d7a49e8ee admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:04.772242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1145/2286] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:04 2022] POST /identity/v3/users => generated 285 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:04.774661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaea99-8602-40de-8422-fc4dd3b6d322 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:04.790557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaea99-8602-40de-8422-fc4dd3b6d322 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:04.797161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4aa5-1867-4238-8d81-9ec72de51d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:04.797879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4aa5-1867-4238-8d81-9ec72de51d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:04.798353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4aa5-1867-4238-8d81-9ec72de51d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:04.798695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4aa5-1867-4238-8d81-9ec72de51d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:04.799469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b4aa5-1867-4238-8d81-9ec72de51d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:04.801381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b4aa5-1867-4238-8d81-9ec72de51d39 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:04.815226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1142/2287] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:40:04.819408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710777b-724d-4049-b027-218d7a49e8ee admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:04.830708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710777b-724d-4049-b027-218d7a49e8ee admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:04.836907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13279490-e9cb-47ad-a751-6bdafb7af2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:04.837927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279490-e9cb-47ad-a751-6bdafb7af2fd admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:04.838436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279490-e9cb-47ad-a751-6bdafb7af2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:04.838930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279490-e9cb-47ad-a751-6bdafb7af2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:04.839840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13279490-e9cb-47ad-a751-6bdafb7af2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:04.841822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13279490-e9cb-47ad-a751-6bdafb7af2fd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:04.859425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4aa5-1867-4238-8d81-9ec72de51d39 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:04.860124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1146/2288] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:04.885696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4aa5-1867-4238-8d81-9ec72de51d39 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:04.900012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67547bb4-cc96-44f7-81fe-c9851af6908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:04.900868 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547bb4-cc96-44f7-81fe-c9851af6908f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:04.902685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547bb4-cc96-44f7-81fe-c9851af6908f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:04.903213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547bb4-cc96-44f7-81fe-c9851af6908f admin admin] PATH_INFO: `/v3/projects/68c83b1788ca42af8ef8498f4b7dc1d1/users/026066970a5a49dfa48944fd44518df2/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:04.944855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67547bb4-cc96-44f7-81fe-c9851af6908f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c83b1788ca42af8ef8498f4b7dc1d1, user_id=026066970a5a49dfa48944fd44518df2, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:04.952058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67547bb4-cc96-44f7-81fe-c9851af6908f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:05.037524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1143/2289] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:04 2022] PUT /identity/v3/projects/68c83b1788ca42af8ef8498f4b7dc1d1/users/026066970a5a49dfa48944fd44518df2/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:05.047593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d9d2-8e5a-40b8-a2af-8d709b459a5b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:05.048191 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d9d2-8e5a-40b8-a2af-8d709b459a5b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:05.051807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d9d2-8e5a-40b8-a2af-8d709b459a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:05.110067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2e91d9d2-8e5a-40b8-a2af-8d709b459a5b None None] MFA Rules not processed for user `026066970a5a49dfa48944fd44518df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:05.111354 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2e91d9d2-8e5a-40b8-a2af-8d709b459a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:05.273123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1147/2290] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:05.288114 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67547bb4-cc96-44f7-81fe-c9851af6908f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:05.290287 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-67547bb4-cc96-44f7-81fe-c9851af6908f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:05.582111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67547bb4-cc96-44f7-81fe-c9851af6908f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:05.594430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbffc6-fe44-43ce-a0c7-01fa8f78f551 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8753f3c218248abbf8018056c67b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:05.595095 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbffc6-fe44-43ce-a0c7-01fa8f78f551 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:05.598339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbffc6-fe44-43ce-a0c7-01fa8f78f551 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:05.598682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbffc6-fe44-43ce-a0c7-01fa8f78f551 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:05.620410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbffc6-fe44-43ce-a0c7-01fa8f78f551 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:05.622091 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbffc6-fe44-43ce-a0c7-01fa8f78f551 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:05.633570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1144/2291] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:40:06.185431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:06.330229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:07.837155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:08.070489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:08.856106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:09.489832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:10.467525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:11.095710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60324ecd-d4e2-4697-b207-e56a5c392f80 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:11.096292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60324ecd-d4e2-4697-b207-e56a5c392f80 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:11.096729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60324ecd-d4e2-4697-b207-e56a5c392f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:11.121484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-60324ecd-d4e2-4697-b207-e56a5c392f80 None None] MFA Rules not processed for user `69a74a81980947d9a2499a4d9ad65823`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:11.124263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60324ecd-d4e2-4697-b207-e56a5c392f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:11.216578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1148/2292] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:11.479495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:11.917030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:13.028137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:13.076399 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbffc6-fe44-43ce-a0c7-01fa8f78f551 service glance] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:13.080058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5dfbffc6-fe44-43ce-a0c7-01fa8f78f551 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:13.164759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbffc6-fe44-43ce-a0c7-01fa8f78f551 service glance] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:13.172580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:13.173291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:13.178907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:13.178907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] PATH_INFO: `/v3/users/f983ef89a788487dad748e743d4e30ba` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:13.178907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f983ef89a788487dad748e743d4e30ba)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:13.178907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:13.287675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:13.386183 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f983ef89a788487dad748e743d4e30ba'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.447782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f983ef89a788487dad748e743d4e30ba'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.448585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f983ef89a788487dad748e743d4e30ba'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.449402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f983ef89a788487dad748e743d4e30ba'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.464901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f983ef89a788487dad748e743d4e30ba'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:13.479927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1145/2293] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:13 2022] DELETE /identity/v3/users/f983ef89a788487dad748e743d4e30ba => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:13.484942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d954d6-7b0b-4d76-b953-03a1f1f6693c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:13.485284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d954d6-7b0b-4d76-b953-03a1f1f6693c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:13.485550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d954d6-7b0b-4d76-b953-03a1f1f6693c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:13.507447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-00d954d6-7b0b-4d76-b953-03a1f1f6693c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:13.509248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-00d954d6-7b0b-4d76-b953-03a1f1f6693c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:13.582494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1149/2294] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:13.593929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:13.595267 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:13.664841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce1acd-6a22-4a24-9b2e-d7857a912d5f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:13.673078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d850c7-5b57-45be-bd9e-99a774e638af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:13.673940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d850c7-5b57-45be-bd9e-99a774e638af service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:13.674320 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d850c7-5b57-45be-bd9e-99a774e638af service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:13.674877 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d850c7-5b57-45be-bd9e-99a774e638af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:13.685849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d850c7-5b57-45be-bd9e-99a774e638af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:13.687438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d850c7-5b57-45be-bd9e-99a774e638af service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:13.728189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1146/2295] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:13.911096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:14.032729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:14.182932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:14.420320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d954d6-7b0b-4d76-b953-03a1f1f6693c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:14.426096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-00d954d6-7b0b-4d76-b953-03a1f1f6693c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:14.471256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d954d6-7b0b-4d76-b953-03a1f1f6693c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:14.480935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:14.482131 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:14.482520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:14.484404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] PATH_INFO: `/v3/projects/290d8bf182a246c48333e87be72cff85` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:14.486008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290d8bf182a246c48333e87be72cff85)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:14.488336 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:14.557192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:14.646958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:14.658085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290d8bf182a246c48333e87be72cff85', 'request_id': 'req-08404178-3a70-4d9c-af01-7a6bb58c87d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:14.668603 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290d8bf182a246c48333e87be72cff85', 'request_id': 'req-08404178-3a70-4d9c-af01-7a6bb58c87d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:14.678844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290d8bf182a246c48333e87be72cff85', 'request_id': 'req-08404178-3a70-4d9c-af01-7a6bb58c87d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:14.786529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] The token cache is being invalidate because project 290d8bf182a246c48333e87be72cff85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:14.797293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:14.797293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-08404178-3a70-4d9c-af01-7a6bb58c87d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:14.797293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1150/2296] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:14 2022] DELETE /identity/v3/projects/290d8bf182a246c48333e87be72cff85 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:14.797642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc060-98bb-460b-97db-e7633a26518d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:14.797642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc060-98bb-460b-97db-e7633a26518d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:14.797642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc060-98bb-460b-97db-e7633a26518d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:14.841378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-057dc060-98bb-460b-97db-e7633a26518d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:14.841378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-057dc060-98bb-460b-97db-e7633a26518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:14.939095 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1147/2297] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:14.947376 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167686a9-beb2-451b-a866-1e5bfbf0f3d9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:14.949942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167686a9-beb2-451b-a866-1e5bfbf0f3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:14.949942 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167686a9-beb2-451b-a866-1e5bfbf0f3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.003730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-167686a9-beb2-451b-a866-1e5bfbf0f3d9 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:15.008930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-167686a9-beb2-451b-a866-1e5bfbf0f3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:15.033335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1151/2298] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:15.036858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dc060-98bb-460b-97db-e7633a26518d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.051238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dc060-98bb-460b-97db-e7633a26518d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.057165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97806e-f7ba-4373-92a1-e9331abedf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.058426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97806e-f7ba-4373-92a1-e9331abedf79 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.058732 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97806e-f7ba-4373-92a1-e9331abedf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.059060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97806e-f7ba-4373-92a1-e9331abedf79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.059871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97806e-f7ba-4373-92a1-e9331abedf79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:40:15.060189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97806e-f7ba-4373-92a1-e9331abedf79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.062003 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97806e-f7ba-4373-92a1-e9331abedf79 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.081183 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1148/2299] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:40:15.086083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167686a9-beb2-451b-a866-1e5bfbf0f3d9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.100487 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167686a9-beb2-451b-a866-1e5bfbf0f3d9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.105429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677a742-82c5-4f8b-a69e-f2ece396c7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.106430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677a742-82c5-4f8b-a69e-f2ece396c7bc admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.106980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677a742-82c5-4f8b-a69e-f2ece396c7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.107447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677a742-82c5-4f8b-a69e-f2ece396c7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.108370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677a742-82c5-4f8b-a69e-f2ece396c7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.110808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677a742-82c5-4f8b-a69e-f2ece396c7bc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.249505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1152/2300] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:15 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:15.254705 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97806e-f7ba-4373-92a1-e9331abedf79 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.265994 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97806e-f7ba-4373-92a1-e9331abedf79 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.375359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddc7c3-fc12-4930-b884-cb6740131042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.376385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddc7c3-fc12-4930-b884-cb6740131042 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.377952 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddc7c3-fc12-4930-b884-cb6740131042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.378337 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddc7c3-fc12-4930-b884-cb6740131042 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.380277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddc7c3-fc12-4930-b884-cb6740131042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.382709 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddc7c3-fc12-4930-b884-cb6740131042 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.498237 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1149/2301] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:15 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:15.502443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677a742-82c5-4f8b-a69e-f2ece396c7bc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.516373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677a742-82c5-4f8b-a69e-f2ece396c7bc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.522677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453200-f741-4101-8104-f71de0b110ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.523367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453200-f741-4101-8104-f71de0b110ee admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.523656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453200-f741-4101-8104-f71de0b110ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.523934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453200-f741-4101-8104-f71de0b110ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.524690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3453200-f741-4101-8104-f71de0b110ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.526440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3453200-f741-4101-8104-f71de0b110ee admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.543203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1153/2302] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:15.547274 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddc7c3-fc12-4930-b884-cb6740131042 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.561490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddc7c3-fc12-4930-b884-cb6740131042 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.568667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a902843-a246-4abb-996e-996c4e1ce530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.569941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a902843-a246-4abb-996e-996c4e1ce530 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.570481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a902843-a246-4abb-996e-996c4e1ce530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.571008 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a902843-a246-4abb-996e-996c4e1ce530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.571796 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a902843-a246-4abb-996e-996c4e1ce530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.573557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a902843-a246-4abb-996e-996c4e1ce530 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.588074 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1150/2303] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:15.592440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453200-f741-4101-8104-f71de0b110ee admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:15.606284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453200-f741-4101-8104-f71de0b110ee admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:15.613894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432107c-a077-45fa-a81a-9f93fca85908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:15.614835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432107c-a077-45fa-a81a-9f93fca85908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.615573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432107c-a077-45fa-a81a-9f93fca85908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.615990 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432107c-a077-45fa-a81a-9f93fca85908 admin admin] PATH_INFO: `/v3/projects/1057d5bd6b2b4e59a43e477e16d4d960/users/a15bb39c097841579ba6e0bb190cb28e/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.634874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432107c-a077-45fa-a81a-9f93fca85908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1057d5bd6b2b4e59a43e477e16d4d960, user_id=a15bb39c097841579ba6e0bb190cb28e, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:15.637998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432107c-a077-45fa-a81a-9f93fca85908 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:15.651941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:15.688755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:15.707186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1154/2304] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:15 2022] PUT /identity/v3/projects/1057d5bd6b2b4e59a43e477e16d4d960/users/a15bb39c097841579ba6e0bb190cb28e/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:15.723456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187201-9e8f-482c-bcd2-646ed95ee0c0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:15.723821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187201-9e8f-482c-bcd2-646ed95ee0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:15.725425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b187201-9e8f-482c-bcd2-646ed95ee0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:15.789118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4b187201-9e8f-482c-bcd2-646ed95ee0c0 None None] MFA Rules not processed for user `a15bb39c097841579ba6e0bb190cb28e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:15.792172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4b187201-9e8f-482c-bcd2-646ed95ee0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:15.991102 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1151/2305] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:15.995684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432107c-a077-45fa-a81a-9f93fca85908 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.132763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432107c-a077-45fa-a81a-9f93fca85908 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.138562 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb3da4-11d2-47b7-8b9d-b7ec361aaacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.139295 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb3da4-11d2-47b7-8b9d-b7ec361aaacc admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.139711 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb3da4-11d2-47b7-8b9d-b7ec361aaacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.139950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb3da4-11d2-47b7-8b9d-b7ec361aaacc admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.140919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb3da4-11d2-47b7-8b9d-b7ec361aaacc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.143918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb3da4-11d2-47b7-8b9d-b7ec361aaacc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.196326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:16.244130 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1155/2306] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:15 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:16.247900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:16.249177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b187201-9e8f-482c-bcd2-646ed95ee0c0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.261217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b187201-9e8f-482c-bcd2-646ed95ee0c0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.330621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914f119-4375-427f-9193-ba632033da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.332084 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914f119-4375-427f-9193-ba632033da47 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.332374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914f119-4375-427f-9193-ba632033da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.332773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914f119-4375-427f-9193-ba632033da47 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.334279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914f119-4375-427f-9193-ba632033da47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.337207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914f119-4375-427f-9193-ba632033da47 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.455825 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1152/2307] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:16 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:40:16.457599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb3da4-11d2-47b7-8b9d-b7ec361aaacc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.470078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb3da4-11d2-47b7-8b9d-b7ec361aaacc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.477907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117939d-1f5a-4a2a-a09c-b296e1bf5539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.478161 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117939d-1f5a-4a2a-a09c-b296e1bf5539 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.478499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117939d-1f5a-4a2a-a09c-b296e1bf5539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.478799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117939d-1f5a-4a2a-a09c-b296e1bf5539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.479604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117939d-1f5a-4a2a-a09c-b296e1bf5539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.482378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117939d-1f5a-4a2a-a09c-b296e1bf5539 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.499521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1156/2308] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:16.500812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914f119-4375-427f-9193-ba632033da47 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.514078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914f119-4375-427f-9193-ba632033da47 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.519700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e49490-5ee8-4318-999a-3179b6bfc1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.520363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49490-5ee8-4318-999a-3179b6bfc1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.520646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49490-5ee8-4318-999a-3179b6bfc1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.520992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49490-5ee8-4318-999a-3179b6bfc1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.522892 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e49490-5ee8-4318-999a-3179b6bfc1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.524547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e49490-5ee8-4318-999a-3179b6bfc1fd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.540693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1153/2309] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:16.542073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117939d-1f5a-4a2a-a09c-b296e1bf5539 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:16.554762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117939d-1f5a-4a2a-a09c-b296e1bf5539 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:16.560883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b334a-133f-4de1-9e69-58ed6e4685f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:16.564744 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b334a-133f-4de1-9e69-58ed6e4685f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.564744 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b334a-133f-4de1-9e69-58ed6e4685f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.564744 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b334a-133f-4de1-9e69-58ed6e4685f0 admin admin] PATH_INFO: `/v3/projects/c7010254f29a47658e8720b2b4a2bce9/users/afe51a452fe14857b8e1d877f64663ee/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.583294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b334a-133f-4de1-9e69-58ed6e4685f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7010254f29a47658e8720b2b4a2bce9, user_id=afe51a452fe14857b8e1d877f64663ee, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:16.587130 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b334a-133f-4de1-9e69-58ed6e4685f0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:16.593341 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:16.676876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1157/2310] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:16 2022] PUT /identity/v3/projects/c7010254f29a47658e8720b2b4a2bce9/users/afe51a452fe14857b8e1d877f64663ee/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:16.688463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b2f6f-8b7c-4f0c-b7c6-8f0050444345 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:16.688758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b2f6f-8b7c-4f0c-b7c6-8f0050444345 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:16.689043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b2f6f-8b7c-4f0c-b7c6-8f0050444345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:16.731531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-892b2f6f-8b7c-4f0c-b7c6-8f0050444345 None None] MFA Rules not processed for user `afe51a452fe14857b8e1d877f64663ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:16.732754 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-892b2f6f-8b7c-4f0c-b7c6-8f0050444345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:16.831155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:16.859241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1154/2311] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:16.898483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b334a-133f-4de1-9e69-58ed6e4685f0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:17.050018 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:17.077186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b334a-133f-4de1-9e69-58ed6e4685f0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:17.091106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91d9e2-83a4-43f7-a0a5-eb8cc49293c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:17.092462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91d9e2-83a4-43f7-a0a5-eb8cc49293c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:17.093313 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91d9e2-83a4-43f7-a0a5-eb8cc49293c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:17.093832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91d9e2-83a4-43f7-a0a5-eb8cc49293c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:17.094768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91d9e2-83a4-43f7-a0a5-eb8cc49293c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:17.097991 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91d9e2-83a4-43f7-a0a5-eb8cc49293c0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:17.137430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:17.264118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1158/2312] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:16 2022] POST /identity/v3/projects => generated 383 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:17.268110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b2f6f-8b7c-4f0c-b7c6-8f0050444345 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:17.278845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:17.284269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b2f6f-8b7c-4f0c-b7c6-8f0050444345 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:17.389929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cda490-a495-4864-8cb2-4894c8159738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:17.392578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cda490-a495-4864-8cb2-4894c8159738 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:17.392971 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cda490-a495-4864-8cb2-4894c8159738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:17.401240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cda490-a495-4864-8cb2-4894c8159738 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:17.402434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cda490-a495-4864-8cb2-4894c8159738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:17.423486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cda490-a495-4864-8cb2-4894c8159738 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:17.553861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1155/2313] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:17 2022] POST /identity/v3/users => generated 298 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:40:17.558209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91d9e2-83a4-43f7-a0a5-eb8cc49293c0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:17.572790 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91d9e2-83a4-43f7-a0a5-eb8cc49293c0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:17.578778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ea479-6af4-4d26-b4ca-901d6d4fce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:17.579708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ea479-6af4-4d26-b4ca-901d6d4fce3a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:17.580166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ea479-6af4-4d26-b4ca-901d6d4fce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:17.580587 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ea479-6af4-4d26-b4ca-901d6d4fce3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:17.581553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ea479-6af4-4d26-b4ca-901d6d4fce3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:17.583346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ea479-6af4-4d26-b4ca-901d6d4fce3a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:17.600520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1159/2314] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:17.604697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cda490-a495-4864-8cb2-4894c8159738 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:17.628318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cda490-a495-4864-8cb2-4894c8159738 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:17.633211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:17.650742 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cb985-1982-4f99-9cd4-185ff25a9ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:17.651447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cb985-1982-4f99-9cd4-185ff25a9ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:17.651750 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cb985-1982-4f99-9cd4-185ff25a9ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:17.652002 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cb985-1982-4f99-9cd4-185ff25a9ba8 admin admin] PATH_INFO: `/v3/projects/c78fe40ea52d4db39695d5097275f214/users/668e7efe6cc54cf8b834f1593a9a14e4/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:17.696479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cb985-1982-4f99-9cd4-185ff25a9ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78fe40ea52d4db39695d5097275f214, user_id=668e7efe6cc54cf8b834f1593a9a14e4, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:17.702397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cb985-1982-4f99-9cd4-185ff25a9ba8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:17.704855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:17.785583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1156/2315] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:17 2022] PUT /identity/v3/projects/c78fe40ea52d4db39695d5097275f214/users/668e7efe6cc54cf8b834f1593a9a14e4/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:17.790815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ea479-6af4-4d26-b4ca-901d6d4fce3a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:17.801529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ea479-6af4-4d26-b4ca-901d6d4fce3a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:17.918266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:17.960089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:17.961044 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a19f4-1aaa-4cde-a2e5-9bd3da4cb3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:17.961888 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a19f4-1aaa-4cde-a2e5-9bd3da4cb3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:17.962546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a19f4-1aaa-4cde-a2e5-9bd3da4cb3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:17.962971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a19f4-1aaa-4cde-a2e5-9bd3da4cb3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:17.964071 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a19f4-1aaa-4cde-a2e5-9bd3da4cb3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:17.968697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a19f4-1aaa-4cde-a2e5-9bd3da4cb3f3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:18.003552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1160/2316] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:40:18.004595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cb985-1982-4f99-9cd4-185ff25a9ba8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:18.020727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cb985-1982-4f99-9cd4-185ff25a9ba8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:18.037414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7d35b-3263-419c-90ec-d6d4d0789b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:18.038148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7d35b-3263-419c-90ec-d6d4d0789b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:18.038448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7d35b-3263-419c-90ec-d6d4d0789b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:18.038729 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7d35b-3263-419c-90ec-d6d4d0789b10 admin admin] PATH_INFO: `/v3/projects/c78fe40ea52d4db39695d5097275f214/users/668e7efe6cc54cf8b834f1593a9a14e4/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:18.044515 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7d35b-3263-419c-90ec-d6d4d0789b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78fe40ea52d4db39695d5097275f214, user_id=668e7efe6cc54cf8b834f1593a9a14e4, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:18.050766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7d35b-3263-419c-90ec-d6d4d0789b10 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:18.090692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1157/2317] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:18 2022] PUT /identity/v3/projects/c78fe40ea52d4db39695d5097275f214/users/668e7efe6cc54cf8b834f1593a9a14e4/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:18.101372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:18.102523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1d14-5db5-4b13-9a18-2f30a057366e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:18.102912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1d14-5db5-4b13-9a18-2f30a057366e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:18.103291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1d14-5db5-4b13-9a18-2f30a057366e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:18.195854 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-834a1d14-5db5-4b13-9a18-2f30a057366e None None] MFA Rules not processed for user `668e7efe6cc54cf8b834f1593a9a14e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:18.197525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-834a1d14-5db5-4b13-9a18-2f30a057366e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:18.256954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:18.299688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1161/2318] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:18.306979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:18.313996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7d35b-3263-419c-90ec-d6d4d0789b10 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:18.316119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3fe7d35b-3263-419c-90ec-d6d4d0789b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:18.484636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7d35b-3263-419c-90ec-d6d4d0789b10 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:18.502837 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f81c8-f37d-4c2e-ac97-b7598ba2b3cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:18.507046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f81c8-f37d-4c2e-ac97-b7598ba2b3cd service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:18.507351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f81c8-f37d-4c2e-ac97-b7598ba2b3cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:18.507634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f81c8-f37d-4c2e-ac97-b7598ba2b3cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:18.658578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f81c8-f37d-4c2e-ac97-b7598ba2b3cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:18.660992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f81c8-f37d-4c2e-ac97-b7598ba2b3cd service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:18.690861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1158/2319] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:18.830522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:18.997949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:19.570532 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:19.631732 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:19.895207 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:20.043710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:20.510141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:20.985623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1d14-5db5-4b13-9a18-2f30a057366e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:20.992858 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1d14-5db5-4b13-9a18-2f30a057366e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:21.000008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f38a5-0dd6-4f6f-a1f0-e9fc1ee3a144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:21.000925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f38a5-0dd6-4f6f-a1f0-e9fc1ee3a144 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:21.002674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f38a5-0dd6-4f6f-a1f0-e9fc1ee3a144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:21.003145 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f38a5-0dd6-4f6f-a1f0-e9fc1ee3a144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:21.095042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:21.108252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f38a5-0dd6-4f6f-a1f0-e9fc1ee3a144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:21.110302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f38a5-0dd6-4f6f-a1f0-e9fc1ee3a144 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:21.122470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1162/2320] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:22.682193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f81c8-f37d-4c2e-ac97-b7598ba2b3cd service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:22.683924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cd6f81c8-f37d-4c2e-ac97-b7598ba2b3cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:22.752386 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f81c8-f37d-4c2e-ac97-b7598ba2b3cd service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:22.758154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716cb76-23c2-4656-8e1b-117e6ed8f0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:22.758154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716cb76-23c2-4656-8e1b-117e6ed8f0cd service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:22.758154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716cb76-23c2-4656-8e1b-117e6ed8f0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:22.758550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716cb76-23c2-4656-8e1b-117e6ed8f0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:22.760302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4716cb76-23c2-4656-8e1b-117e6ed8f0cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:22.774066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:22.860335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716cb76-23c2-4656-8e1b-117e6ed8f0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:22.862234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716cb76-23c2-4656-8e1b-117e6ed8f0cd service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:22.872847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1159/2321] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:23.225374 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f38a5-0dd6-4f6f-a1f0-e9fc1ee3a144 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:23.235166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f38a5-0dd6-4f6f-a1f0-e9fc1ee3a144 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:23.239574 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb75ca-8446-4029-8ce9-b2cbc4f6efe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:23.240617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb75ca-8446-4029-8ce9-b2cbc4f6efe6 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:23.241068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb75ca-8446-4029-8ce9-b2cbc4f6efe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:23.241566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb75ca-8446-4029-8ce9-b2cbc4f6efe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:23.251978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb75ca-8446-4029-8ce9-b2cbc4f6efe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:23.253634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb75ca-8446-4029-8ce9-b2cbc4f6efe6 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:23.278936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1163/2322] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:23.986678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2697eea-5933-4a24-84c7-7063b93f2477 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:23.987219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2697eea-5933-4a24-84c7-7063b93f2477 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:23.987219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2697eea-5933-4a24-84c7-7063b93f2477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:24.045027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a2697eea-5933-4a24-84c7-7063b93f2477 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:24.049394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a2697eea-5933-4a24-84c7-7063b93f2477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:24.160908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1160/2323] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:40:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:24.180076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb75ca-8446-4029-8ce9-b2cbc4f6efe6 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:24.184124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45fb75ca-8446-4029-8ce9-b2cbc4f6efe6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:24.278834 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb75ca-8446-4029-8ce9-b2cbc4f6efe6 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:24.287464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff46f9-be0f-4e8a-bdc0-45acb1d0ad20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:24.288682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff46f9-be0f-4e8a-bdc0-45acb1d0ad20 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:24.289358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff46f9-be0f-4e8a-bdc0-45acb1d0ad20 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:24.290086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff46f9-be0f-4e8a-bdc0-45acb1d0ad20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:24.301686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff46f9-be0f-4e8a-bdc0-45acb1d0ad20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:24.308976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff46f9-be0f-4e8a-bdc0-45acb1d0ad20 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:24.316818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1164/2324] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:40:25.780400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793dc4-1d35-418a-938a-1a7e3a78f2f8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:25.781342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793dc4-1d35-418a-938a-1a7e3a78f2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:25.782123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793dc4-1d35-418a-938a-1a7e3a78f2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:25.815285 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c3793dc4-1d35-418a-938a-1a7e3a78f2f8 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:25.818075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c3793dc4-1d35-418a-938a-1a7e3a78f2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:25.825817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1161/2325] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:40:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:25.846881 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff46f9-be0f-4e8a-bdc0-45acb1d0ad20 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:25.859230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff46f9-be0f-4e8a-bdc0-45acb1d0ad20 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:25.869022 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7930342-970d-44db-9820-b4c1e465a41d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:25.869706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7930342-970d-44db-9820-b4c1e465a41d service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:25.869974 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7930342-970d-44db-9820-b4c1e465a41d service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:25.870428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7930342-970d-44db-9820-b4c1e465a41d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:25.882076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7930342-970d-44db-9820-b4c1e465a41d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:25.883904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7930342-970d-44db-9820-b4c1e465a41d service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:25.896834 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1165/2326] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:40:28.885724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3793dc4-1d35-418a-938a-1a7e3a78f2f8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:29.032314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3793dc4-1d35-418a-938a-1a7e3a78f2f8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:29.064573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:29.065601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:29.066044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:29.066770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] PATH_INFO: `/v3/users/a15bb39c097841579ba6e0bb190cb28e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:29.069065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15bb39c097841579ba6e0bb190cb28e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:29.074890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:29.220067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d74d0-f9b6-4dcb-8601-6ee5380c37ef None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:29.220574 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d74d0-f9b6-4dcb-8601-6ee5380c37ef None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:29.220672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d74d0-f9b6-4dcb-8601-6ee5380c37ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:29.251761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-010d74d0-f9b6-4dcb-8601-6ee5380c37ef None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:29.253571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-010d74d0-f9b6-4dcb-8601-6ee5380c37ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:29.262428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1166/2327] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 05:40:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:29.284843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d74d0-f9b6-4dcb-8601-6ee5380c37ef None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:29.299754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d74d0-f9b6-4dcb-8601-6ee5380c37ef None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:29.310663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17583d1e-e2a0-45cd-b979-69fce71cd018 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:29.311575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17583d1e-e2a0-45cd-b979-69fce71cd018 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:29.312010 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17583d1e-e2a0-45cd-b979-69fce71cd018 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:29.312424 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17583d1e-e2a0-45cd-b979-69fce71cd018 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:29.315402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:29.317544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15bb39c097841579ba6e0bb190cb28e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:29.327786 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17583d1e-e2a0-45cd-b979-69fce71cd018 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:29.333591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17583d1e-e2a0-45cd-b979-69fce71cd018 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:29.347076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1167/2328] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 05:40:29.369572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15bb39c097841579ba6e0bb190cb28e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:29.370523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15bb39c097841579ba6e0bb190cb28e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:29.371461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15bb39c097841579ba6e0bb190cb28e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:29.391203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15bb39c097841579ba6e0bb190cb28e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:29.418612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1162/2329] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:28 2022] DELETE /identity/v3/users/a15bb39c097841579ba6e0bb190cb28e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:29.420272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa45a81-1d63-4fe4-bcb1-149c071cdc27 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:29.420675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa45a81-1d63-4fe4-bcb1-149c071cdc27 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:29.421081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa45a81-1d63-4fe4-bcb1-149c071cdc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:29.460873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4fa45a81-1d63-4fe4-bcb1-149c071cdc27 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:29.465678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4fa45a81-1d63-4fe4-bcb1-149c071cdc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:29.597415 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1168/2330] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:29.615168 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:29.616684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:29.724918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539d36c-389e-450a-af6a-dcb0a1b0c853 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:29.728970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a48e12-5271-499f-a4bc-bba6fb077633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:29.729647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48e12-5271-499f-a4bc-bba6fb077633 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:29.730481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48e12-5271-499f-a4bc-bba6fb077633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:29.730481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48e12-5271-499f-a4bc-bba6fb077633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:29.775315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a48e12-5271-499f-a4bc-bba6fb077633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:29.780647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a48e12-5271-499f-a4bc-bba6fb077633 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:29.820022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1163/2331] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:30.141358 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7f54-2ff4-431e-9073-1d56204f3bd7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:30.141647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7f54-2ff4-431e-9073-1d56204f3bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:30.142092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7f54-2ff4-431e-9073-1d56204f3bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:30.167818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ce0e7f54-2ff4-431e-9073-1d56204f3bd7 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:30.169345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ce0e7f54-2ff4-431e-9073-1d56204f3bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:30.213257 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:30.249673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1169/2332] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 05:40:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:30.271849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a48e12-5271-499f-a4bc-bba6fb077633 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:30.271849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-88a48e12-5271-499f-a4bc-bba6fb077633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:30.369308 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a48e12-5271-499f-a4bc-bba6fb077633 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:30.375838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c03b1-ebdc-42e4-8510-21e33f9b1768 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:30.376835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c03b1-ebdc-42e4-8510-21e33f9b1768 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:30.377665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c03b1-ebdc-42e4-8510-21e33f9b1768 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:30.378723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c03b1-ebdc-42e4-8510-21e33f9b1768 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:30.389309 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c03b1-ebdc-42e4-8510-21e33f9b1768 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:30.391194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c03b1-ebdc-42e4-8510-21e33f9b1768 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:30.401167 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1164/2333] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:40:30.472101 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e7f54-2ff4-431e-9073-1d56204f3bd7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:30.474550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ce0e7f54-2ff4-431e-9073-1d56204f3bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:30.507448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e7f54-2ff4-431e-9073-1d56204f3bd7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:30.514638 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:30.516075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:30.516461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:30.516969 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] PATH_INFO: `/v3/projects/1057d5bd6b2b4e59a43e477e16d4d960` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:30.530739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1057d5bd6b2b4e59a43e477e16d4d960)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:30.534126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:31.038729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1057d5bd6b2b4e59a43e477e16d4d960', 'request_id': 'req-3f8ed110-6f38-44c6-97b8-43235847627d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:31.044911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1057d5bd6b2b4e59a43e477e16d4d960', 'request_id': 'req-3f8ed110-6f38-44c6-97b8-43235847627d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:31.050404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1057d5bd6b2b4e59a43e477e16d4d960', 'request_id': 'req-3f8ed110-6f38-44c6-97b8-43235847627d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:31.561188 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] The token cache is being invalidate because project 1057d5bd6b2b4e59a43e477e16d4d960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:31.567966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:31.567966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:31.567966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1170/2334] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:30 2022] DELETE /identity/v3/projects/1057d5bd6b2b4e59a43e477e16d4d960 => generated 0 bytes in 1092 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:31.568458 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c03b1-ebdc-42e4-8510-21e33f9b1768 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:31.578626 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c03b1-ebdc-42e4-8510-21e33f9b1768 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:31.642869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:31.670478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:31.671560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:31.672000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:31.672793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] PATH_INFO: `/v3/users/afe51a452fe14857b8e1d877f64663ee` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:31.674992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe51a452fe14857b8e1d877f64663ee)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:31.678476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:31.932449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe51a452fe14857b8e1d877f64663ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:32.058694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe51a452fe14857b8e1d877f64663ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:32.065556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe51a452fe14857b8e1d877f64663ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:32.065556 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe51a452fe14857b8e1d877f64663ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:32.077320 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe51a452fe14857b8e1d877f64663ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:32.098505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1165/2335] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:31 2022] DELETE /identity/v3/users/afe51a452fe14857b8e1d877f64663ee => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:32.679470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:32.681670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:32.723173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ed110-6f38-44c6-97b8-43235847627d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:32.804038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:32.805063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:32.805632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:32.806011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] PATH_INFO: `/v3/projects/c7010254f29a47658e8720b2b4a2bce9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:32.807405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7010254f29a47658e8720b2b4a2bce9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:32.810081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:33.001068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7010254f29a47658e8720b2b4a2bce9', 'request_id': 'req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.010927 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7010254f29a47658e8720b2b4a2bce9', 'request_id': 'req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.042574 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7010254f29a47658e8720b2b4a2bce9', 'request_id': 'req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.046430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:33.130872 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] The token cache is being invalidate because project c7010254f29a47658e8720b2b4a2bce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:33.131094 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.133541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5ed4eb9f-ad8b-4bb8-83c7-2371351e7a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.135241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1171/2336] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:32 2022] DELETE /identity/v3/projects/c7010254f29a47658e8720b2b4a2bce9 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:33.139336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:33.140781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:33.157061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991227b-f333-4300-a6e7-f4331c054024 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:33.232527 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1658a-ec28-4b83-a6c3-e88d9f33c4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:33.234033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1658a-ec28-4b83-a6c3-e88d9f33c4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:33.235672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1658a-ec28-4b83-a6c3-e88d9f33c4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:33.235979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bf76b-cf1b-44db-9002-53f82c33f242 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:33.236115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1658a-ec28-4b83-a6c3-e88d9f33c4da admin admin] PATH_INFO: `/v3/users/668e7efe6cc54cf8b834f1593a9a14e4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:33.236267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bf76b-cf1b-44db-9002-53f82c33f242 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:33.236829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bf76b-cf1b-44db-9002-53f82c33f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:33.237369 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1658a-ec28-4b83-a6c3-e88d9f33c4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=668e7efe6cc54cf8b834f1593a9a14e4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:33.239522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1658a-ec28-4b83-a6c3-e88d9f33c4da admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:33.269933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e30bf76b-cf1b-44db-9002-53f82c33f242 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:33.272196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e30bf76b-cf1b-44db-9002-53f82c33f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:33.350025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1172/2337] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:40:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:33.367987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bf76b-cf1b-44db-9002-53f82c33f242 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:33.369449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e30bf76b-cf1b-44db-9002-53f82c33f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:33.463931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bf76b-cf1b-44db-9002-53f82c33f242 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:33.469320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61e319-8cb9-4a14-99be-e6d4f5a96196 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:33.469909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61e319-8cb9-4a14-99be-e6d4f5a96196 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:33.470222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61e319-8cb9-4a14-99be-e6d4f5a96196 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:33.470721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61e319-8cb9-4a14-99be-e6d4f5a96196 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:33.480536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61e319-8cb9-4a14-99be-e6d4f5a96196 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:33.482729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61e319-8cb9-4a14-99be-e6d4f5a96196 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:33.491459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1173/2338] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:40:33.502251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20a1658a-ec28-4b83-a6c3-e88d9f33c4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668e7efe6cc54cf8b834f1593a9a14e4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.603745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20a1658a-ec28-4b83-a6c3-e88d9f33c4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668e7efe6cc54cf8b834f1593a9a14e4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.605794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20a1658a-ec28-4b83-a6c3-e88d9f33c4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668e7efe6cc54cf8b834f1593a9a14e4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.606763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20a1658a-ec28-4b83-a6c3-e88d9f33c4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668e7efe6cc54cf8b834f1593a9a14e4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.622047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20a1658a-ec28-4b83-a6c3-e88d9f33c4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668e7efe6cc54cf8b834f1593a9a14e4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:33.636085 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:33.641768 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1166/2339] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:33 2022] DELETE /identity/v3/users/668e7efe6cc54cf8b834f1593a9a14e4 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:40:34.170410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61e319-8cb9-4a14-99be-e6d4f5a96196 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:34.174703 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bf61e319-8cb9-4a14-99be-e6d4f5a96196 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:34.191218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61e319-8cb9-4a14-99be-e6d4f5a96196 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:34.338238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:34.339536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:34.339826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:34.340100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] PATH_INFO: `/v3/projects/c78fe40ea52d4db39695d5097275f214` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:34.341678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78fe40ea52d4db39695d5097275f214)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:34.344715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:34.361255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b5805-54a2-436c-b30e-8cd39d84f8da None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:34.361725 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b5805-54a2-436c-b30e-8cd39d84f8da None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:34.362691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b5805-54a2-436c-b30e-8cd39d84f8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:34.394385 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a30b5805-54a2-436c-b30e-8cd39d84f8da None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:34.396492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a30b5805-54a2-436c-b30e-8cd39d84f8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:34.477249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:34.510625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78fe40ea52d4db39695d5097275f214', 'request_id': 'req-3b84879b-c303-46fd-b1c2-5169c2003ab1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:34.521997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1167/2340] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:34.522988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78fe40ea52d4db39695d5097275f214', 'request_id': 'req-3b84879b-c303-46fd-b1c2-5169c2003ab1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:34.530359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78fe40ea52d4db39695d5097275f214', 'request_id': 'req-3b84879b-c303-46fd-b1c2-5169c2003ab1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:34.538037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b5805-54a2-436c-b30e-8cd39d84f8da None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:34.541917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a30b5805-54a2-436c-b30e-8cd39d84f8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:34.666545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] The token cache is being invalidate because project c78fe40ea52d4db39695d5097275f214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:34.666849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:34.673832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b84879b-c303-46fd-b1c2-5169c2003ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:34.676402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b5805-54a2-436c-b30e-8cd39d84f8da None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:34.681038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1174/2341] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:34 2022] DELETE /identity/v3/projects/c78fe40ea52d4db39695d5097275f214 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:34.688732 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bc51e-d74d-4074-8906-ef0c6f1dd8f7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:34.690252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bc51e-d74d-4074-8906-ef0c6f1dd8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:34.691430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bc51e-d74d-4074-8906-ef0c6f1dd8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:34.741689 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-505bc51e-d74d-4074-8906-ef0c6f1dd8f7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:34.744011 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-505bc51e-d74d-4074-8906-ef0c6f1dd8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:34.842357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1175/2342] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:34.848627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe686c-7a60-4a31-b0a2-9e67c363cc35 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:34.849104 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe686c-7a60-4a31-b0a2-9e67c363cc35 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:34.850187 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe686c-7a60-4a31-b0a2-9e67c363cc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:34.853628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8fc5a-763a-4d08-917a-1381cdab88cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:34.854273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8fc5a-763a-4d08-917a-1381cdab88cd service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:34.854548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8fc5a-763a-4d08-917a-1381cdab88cd service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:34.854812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8fc5a-763a-4d08-917a-1381cdab88cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:34.860352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d2a8fc5a-763a-4d08-917a-1381cdab88cd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:34.886385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9ebe686c-7a60-4a31-b0a2-9e67c363cc35 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:34.888447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9ebe686c-7a60-4a31-b0a2-9e67c363cc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:34.900309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1176/2343] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:34.904220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe686c-7a60-4a31-b0a2-9e67c363cc35 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:34.920450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe686c-7a60-4a31-b0a2-9e67c363cc35 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:34.926018 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90034b39-b9a9-48ae-bde9-a03d4309c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:34.927017 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90034b39-b9a9-48ae-bde9-a03d4309c9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:34.927418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90034b39-b9a9-48ae-bde9-a03d4309c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:34.927837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90034b39-b9a9-48ae-bde9-a03d4309c9aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:34.928606 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90034b39-b9a9-48ae-bde9-a03d4309c9aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:40:34.928913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90034b39-b9a9-48ae-bde9-a03d4309c9aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:34.931150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90034b39-b9a9-48ae-bde9-a03d4309c9aa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:34.936612 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:34.954448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1177/2344] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:40:34.956343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90034b39-b9a9-48ae-bde9-a03d4309c9aa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:34.971407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8fc5a-763a-4d08-917a-1381cdab88cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:34.973109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8fc5a-763a-4d08-917a-1381cdab88cd service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:34.975392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90034b39-b9a9-48ae-bde9-a03d4309c9aa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:34.985649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3a2e6-d26f-4a5b-a8eb-80b1b906cd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:34.986383 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1168/2345] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:40:34.986532 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3a2e6-d26f-4a5b-a8eb-80b1b906cd12 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:34.986832 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3a2e6-d26f-4a5b-a8eb-80b1b906cd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:34.987106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3a2e6-d26f-4a5b-a8eb-80b1b906cd12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:34.988254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3a2e6-d26f-4a5b-a8eb-80b1b906cd12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:34.990399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3a2e6-d26f-4a5b-a8eb-80b1b906cd12 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:35.165300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1178/2346] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:34 2022] POST /identity/v3/projects => generated 363 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:35.171076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8fc5a-763a-4d08-917a-1381cdab88cd service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:35.185298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8fc5a-763a-4d08-917a-1381cdab88cd service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:35.284081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df2b2e-57f7-42f7-bbc3-5bea61b0a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:35.285189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2b2e-57f7-42f7-bbc3-5bea61b0a195 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:35.285544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2b2e-57f7-42f7-bbc3-5bea61b0a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:35.286559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2b2e-57f7-42f7-bbc3-5bea61b0a195 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:35.288156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df2b2e-57f7-42f7-bbc3-5bea61b0a195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:35.290353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df2b2e-57f7-42f7-bbc3-5bea61b0a195 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:35.310866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e042379-d179-40a3-8036-942e54dffcb0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:35.311399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e042379-d179-40a3-8036-942e54dffcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:35.311399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e042379-d179-40a3-8036-942e54dffcb0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:35.313298 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1179/2347] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 05:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 05:40:35.350968 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47041e8-a706-4d83-a50d-c95eab7fb16c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:35.351304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47041e8-a706-4d83-a50d-c95eab7fb16c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:35.351528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47041e8-a706-4d83-a50d-c95eab7fb16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:35.393597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f47041e8-a706-4d83-a50d-c95eab7fb16c None None] MFA Rules not processed for user `a5593bc41bce41b4b44616c355976cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:35.394842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f47041e8-a706-4d83-a50d-c95eab7fb16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:35.485010 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1180/2348] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 05:40:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:35.496882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47041e8-a706-4d83-a50d-c95eab7fb16c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:35.498264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f47041e8-a706-4d83-a50d-c95eab7fb16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:35.512563 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47041e8-a706-4d83-a50d-c95eab7fb16c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:35.517887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ee050-e45f-4037-9d6e-1173784297eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5593bc41bce41b4b44616c355976cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:35.518509 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ee050-e45f-4037-9d6e-1173784297eb service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:35.518790 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ee050-e45f-4037-9d6e-1173784297eb service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:35.519070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ee050-e45f-4037-9d6e-1173784297eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:35.528105 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ee050-e45f-4037-9d6e-1173784297eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:35.529734 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ee050-e45f-4037-9d6e-1173784297eb service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:35.536402 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:35.541045 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1181/2349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:40:35.607338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1169/2350] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:35 2022] POST /identity/v3/users => generated 282 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:35.611360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ee050-e45f-4037-9d6e-1173784297eb service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:35.623864 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ee050-e45f-4037-9d6e-1173784297eb service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:35.628724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea124c7-51a6-457f-9d5e-0e44cbe9da48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:35.629459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea124c7-51a6-457f-9d5e-0e44cbe9da48 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:35.630323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea124c7-51a6-457f-9d5e-0e44cbe9da48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:35.630630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea124c7-51a6-457f-9d5e-0e44cbe9da48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:35.631309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea124c7-51a6-457f-9d5e-0e44cbe9da48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:35.632907 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea124c7-51a6-457f-9d5e-0e44cbe9da48 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:35.643544 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1182/2351] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:35.647883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df2b2e-57f7-42f7-bbc3-5bea61b0a195 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:35.658570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df2b2e-57f7-42f7-bbc3-5bea61b0a195 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:35.668029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572c3ee-0096-42c8-a325-8f1d99288aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:35.668694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572c3ee-0096-42c8-a325-8f1d99288aaf admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:35.669019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572c3ee-0096-42c8-a325-8f1d99288aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:35.669506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572c3ee-0096-42c8-a325-8f1d99288aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:35.670216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572c3ee-0096-42c8-a325-8f1d99288aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:35.672090 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572c3ee-0096-42c8-a325-8f1d99288aaf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:35.685349 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1170/2352] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:40:35.689698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea124c7-51a6-457f-9d5e-0e44cbe9da48 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:35.702635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572c3ee-0096-42c8-a325-8f1d99288aaf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:35.703646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea124c7-51a6-457f-9d5e-0e44cbe9da48 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:35.705918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3572c3ee-0096-42c8-a325-8f1d99288aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:35.709768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74a9d7-da56-45e4-b7ca-f32129ebf631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:35.710471 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74a9d7-da56-45e4-b7ca-f32129ebf631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:35.710755 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74a9d7-da56-45e4-b7ca-f32129ebf631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:35.711032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74a9d7-da56-45e4-b7ca-f32129ebf631 admin admin] PATH_INFO: `/v3/projects/1186d6b17b0348318e11615a9cdb636d/users/33d22d597a28470daad409458979bf1b/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:35.731573 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572c3ee-0096-42c8-a325-8f1d99288aaf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:35.742073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74a9d7-da56-45e4-b7ca-f32129ebf631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1186d6b17b0348318e11615a9cdb636d, user_id=33d22d597a28470daad409458979bf1b, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:35.742322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:35.742322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:35.742322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:35.742322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] PATH_INFO: `/v3/users/28831626fd594dc281d1ddd1aa3bab2b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:35.742736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74a9d7-da56-45e4-b7ca-f32129ebf631 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:35.742835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28831626fd594dc281d1ddd1aa3bab2b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:35.743192 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:35.836381 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1183/2353] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:35 2022] PUT /identity/v3/projects/1186d6b17b0348318e11615a9cdb636d/users/33d22d597a28470daad409458979bf1b/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:35.837736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5674f9-509f-449d-b8fb-65673f15a5f8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:35.838613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5674f9-509f-449d-b8fb-65673f15a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:35.838613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5674f9-509f-449d-b8fb-65673f15a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:35.891417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9f5674f9-509f-449d-b8fb-65673f15a5f8 None None] MFA Rules not processed for user `33d22d597a28470daad409458979bf1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:35.892659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9f5674f9-509f-449d-b8fb-65673f15a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:36.001293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28831626fd594dc281d1ddd1aa3bab2b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:36.033523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1184/2354] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:36.049273 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5674f9-509f-449d-b8fb-65673f15a5f8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:36.053407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9f5674f9-509f-449d-b8fb-65673f15a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:36.088142 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28831626fd594dc281d1ddd1aa3bab2b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:36.088893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28831626fd594dc281d1ddd1aa3bab2b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:36.089593 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28831626fd594dc281d1ddd1aa3bab2b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:36.112630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28831626fd594dc281d1ddd1aa3bab2b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:36.146998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5674f9-509f-449d-b8fb-65673f15a5f8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:36.148674 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1171/2355] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:35 2022] DELETE /identity/v3/users/28831626fd594dc281d1ddd1aa3bab2b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:36.343956 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fa633-d36a-4863-8e70-aa9558723300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:36.344720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fa633-d36a-4863-8e70-aa9558723300 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:36.344900 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fa633-d36a-4863-8e70-aa9558723300 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:36.345178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fa633-d36a-4863-8e70-aa9558723300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:36.356220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d7fa633-d36a-4863-8e70-aa9558723300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:36.447690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fa633-d36a-4863-8e70-aa9558723300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:36.451585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fa633-d36a-4863-8e70-aa9558723300 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:36.463412 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1185/2356] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:36 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:36.576436 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:36.578022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:36.660331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:36.711123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64103873-b84b-4a84-b3e9-737baa40e030 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:36.718225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:36.719235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:36.719760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:36.721328 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] PATH_INFO: `/v3/projects/6406111471434836bd443bafa78d2e04` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:36.724079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6406111471434836bd443bafa78d2e04)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:36.730395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:36.877650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6406111471434836bd443bafa78d2e04', 'request_id': 'req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:36.885945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6406111471434836bd443bafa78d2e04', 'request_id': 'req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:36.892735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6406111471434836bd443bafa78d2e04', 'request_id': 'req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:37.013814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] The token cache is being invalidate because project 6406111471434836bd443bafa78d2e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:37.020027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:37.020027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d94b5e32-3bb3-4dde-94e4-b398c7262d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:37.020027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1172/2357] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:36 2022] DELETE /identity/v3/projects/6406111471434836bd443bafa78d2e04 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:37.315309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:39.226098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fa633-d36a-4863-8e70-aa9558723300 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:39.229771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d7fa633-d36a-4863-8e70-aa9558723300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:39.244675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fa633-d36a-4863-8e70-aa9558723300 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:39.323835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:39.324878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:39.325439 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:39.325922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] PATH_INFO: `/v3/users/d19a72ed2e9040c6a8463a63e42f3d61` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:39.327327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19a72ed2e9040c6a8463a63e42f3d61)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:39.330219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:39.657463 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19a72ed2e9040c6a8463a63e42f3d61'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:39.658153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19a72ed2e9040c6a8463a63e42f3d61'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:39.859684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19a72ed2e9040c6a8463a63e42f3d61'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:39.860487 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19a72ed2e9040c6a8463a63e42f3d61'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:39.874405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19a72ed2e9040c6a8463a63e42f3d61'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:39.888682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1186/2358] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:39 2022] DELETE /identity/v3/users/d19a72ed2e9040c6a8463a63e42f3d61 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:39.892889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7903ee6-3f97-460f-8218-ce1b889809c0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:39.893430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7903ee6-3f97-460f-8218-ce1b889809c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:39.893599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7903ee6-3f97-460f-8218-ce1b889809c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:39.914154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c7903ee6-3f97-460f-8218-ce1b889809c0 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:39.915282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c7903ee6-3f97-460f-8218-ce1b889809c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:39.978270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1173/2359] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:39.988265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:39.989837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:40.055244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:40.058019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73212a92-0db7-425f-b0aa-de947926bbae admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:40.061712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357f032-23c1-4091-b687-78e1ce9c0f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:40.062488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357f032-23c1-4091-b687-78e1ce9c0f98 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:40.062773 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357f032-23c1-4091-b687-78e1ce9c0f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:40.063045 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357f032-23c1-4091-b687-78e1ce9c0f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:40.073620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357f032-23c1-4091-b687-78e1ce9c0f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:40.075058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357f032-23c1-4091-b687-78e1ce9c0f98 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:40.084946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1187/2360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:40.335857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7903ee6-3f97-460f-8218-ce1b889809c0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:40.338220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c7903ee6-3f97-460f-8218-ce1b889809c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:40.364178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7903ee6-3f97-460f-8218-ce1b889809c0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:40.375490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:40.376958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:40.377271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:40.378019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] PATH_INFO: `/v3/projects/b2a855302f2f40a3b5d5e1a9ae6e91bf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:40.379272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a855302f2f40a3b5d5e1a9ae6e91bf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:40.381930 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:40.593059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a855302f2f40a3b5d5e1a9ae6e91bf', 'request_id': 'req-4cd555b9-abee-40d2-b5b6-a032b917f69b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:40.606663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a855302f2f40a3b5d5e1a9ae6e91bf', 'request_id': 'req-4cd555b9-abee-40d2-b5b6-a032b917f69b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:40.617589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:40.623457 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a855302f2f40a3b5d5e1a9ae6e91bf', 'request_id': 'req-4cd555b9-abee-40d2-b5b6-a032b917f69b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:40.734900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] The token cache is being invalidate because project b2a855302f2f40a3b5d5e1a9ae6e91bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:40.735223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:40.736417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4cd555b9-abee-40d2-b5b6-a032b917f69b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:40.737798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1174/2361] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:40 2022] DELETE /identity/v3/projects/b2a855302f2f40a3b5d5e1a9ae6e91bf => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:42.862490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357f032-23c1-4091-b687-78e1ce9c0f98 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:42.864203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5357f032-23c1-4091-b687-78e1ce9c0f98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:42.877842 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357f032-23c1-4091-b687-78e1ce9c0f98 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:42.963271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:42.963878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:42.964156 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:42.964435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] PATH_INFO: `/v3/users/026066970a5a49dfa48944fd44518df2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:42.969911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] RBAC: Authorizing `identity:delete_user(user_id=026066970a5a49dfa48944fd44518df2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:42.972070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:43.193698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026066970a5a49dfa48944fd44518df2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:43.194366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026066970a5a49dfa48944fd44518df2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:43.291926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026066970a5a49dfa48944fd44518df2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:43.297840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026066970a5a49dfa48944fd44518df2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:43.308329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026066970a5a49dfa48944fd44518df2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:43.323181 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1188/2362] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:42 2022] DELETE /identity/v3/users/026066970a5a49dfa48944fd44518df2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:43.327699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71df21-a44d-42be-8da2-5c25b71cdfaa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:43.328166 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71df21-a44d-42be-8da2-5c25b71cdfaa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:43.328259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71df21-a44d-42be-8da2-5c25b71cdfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:43.350375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1d71df21-a44d-42be-8da2-5c25b71cdfaa None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:43.351599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1d71df21-a44d-42be-8da2-5c25b71cdfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:43.414265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1175/2363] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:43.424575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:43.426147 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:43.490014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69836502-0fc7-4a46-8307-0b23b4c5c91b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:43.493982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb06e77-ae4a-4d9f-b420-920f6412eaa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:43.494619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06e77-ae4a-4d9f-b420-920f6412eaa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:43.494896 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06e77-ae4a-4d9f-b420-920f6412eaa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:43.495190 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06e77-ae4a-4d9f-b420-920f6412eaa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:43.506006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb06e77-ae4a-4d9f-b420-920f6412eaa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:43.507491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb06e77-ae4a-4d9f-b420-920f6412eaa0 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:43.517231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1189/2364] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:40:43.928708 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71df21-a44d-42be-8da2-5c25b71cdfaa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:43.930149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1d71df21-a44d-42be-8da2-5c25b71cdfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:43.944639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71df21-a44d-42be-8da2-5c25b71cdfaa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:43.955350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:43.956010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:43.956290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:43.956563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] PATH_INFO: `/v3/projects/68c83b1788ca42af8ef8498f4b7dc1d1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:43.959007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c83b1788ca42af8ef8498f4b7dc1d1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:43.960924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:44.063258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c83b1788ca42af8ef8498f4b7dc1d1', 'request_id': 'req-f4c06537-a892-4cc3-b2c9-50f11e7482c9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:44.069576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c83b1788ca42af8ef8498f4b7dc1d1', 'request_id': 'req-f4c06537-a892-4cc3-b2c9-50f11e7482c9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:44.075127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c83b1788ca42af8ef8498f4b7dc1d1', 'request_id': 'req-f4c06537-a892-4cc3-b2c9-50f11e7482c9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:44.136992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] The token cache is being invalidate because project 68c83b1788ca42af8ef8498f4b7dc1d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:44.137312 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:44.137945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f4c06537-a892-4cc3-b2c9-50f11e7482c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:44.139657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1176/2365] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:43 2022] DELETE /identity/v3/projects/68c83b1788ca42af8ef8498f4b7dc1d1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:44.144417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b15a-23df-4a43-a989-0cd6df1e14ea None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:44.145459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b15a-23df-4a43-a989-0cd6df1e14ea None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:44.145555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b15a-23df-4a43-a989-0cd6df1e14ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:44.167467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bca3b15a-23df-4a43-a989-0cd6df1e14ea None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:44.168694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bca3b15a-23df-4a43-a989-0cd6df1e14ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:44.173753 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:44.231833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1190/2366] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:44.241393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fa79d-6f97-41d7-a1cf-9c22882065a7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:44.241680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fa79d-6f97-41d7-a1cf-9c22882065a7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:44.241950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fa79d-6f97-41d7-a1cf-9c22882065a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:44.264336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e72fa79d-6f97-41d7-a1cf-9c22882065a7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:44.265578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e72fa79d-6f97-41d7-a1cf-9c22882065a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:44.274136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1177/2367] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:44.284464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b15a-23df-4a43-a989-0cd6df1e14ea None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:44.294953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b15a-23df-4a43-a989-0cd6df1e14ea None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:44.299756 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f958-1397-43cf-adee-7610c15a7562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:44.300360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f958-1397-43cf-adee-7610c15a7562 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:44.300645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f958-1397-43cf-adee-7610c15a7562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:44.300919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f958-1397-43cf-adee-7610c15a7562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:44.302263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12f958-1397-43cf-adee-7610c15a7562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:40:44.302568 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12f958-1397-43cf-adee-7610c15a7562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:44.304204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12f958-1397-43cf-adee-7610c15a7562 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:44.316472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1191/2368] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:40:44.320686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fa79d-6f97-41d7-a1cf-9c22882065a7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:44.330300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fa79d-6f97-41d7-a1cf-9c22882065a7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:44.335228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41680208-d360-4633-be48-6fff3676a29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:44.335843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680208-d360-4633-be48-6fff3676a29d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:44.336123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680208-d360-4633-be48-6fff3676a29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:44.336388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680208-d360-4633-be48-6fff3676a29d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:44.337075 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41680208-d360-4633-be48-6fff3676a29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:44.339126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41680208-d360-4633-be48-6fff3676a29d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:44.412353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1178/2369] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:40:44 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:44.413644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f958-1397-43cf-adee-7610c15a7562 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:44.423869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f958-1397-43cf-adee-7610c15a7562 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:44.486485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c4537-2b18-45c2-8198-1e9062561f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:44.487121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c4537-2b18-45c2-8198-1e9062561f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:44.488211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c4537-2b18-45c2-8198-1e9062561f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:44.488211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c4537-2b18-45c2-8198-1e9062561f78 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:44.488504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c4537-2b18-45c2-8198-1e9062561f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:44.490865 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c4537-2b18-45c2-8198-1e9062561f78 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:44.603740 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1192/2370] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:40:44 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:40:44.608044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41680208-d360-4633-be48-6fff3676a29d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:44.618815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41680208-d360-4633-be48-6fff3676a29d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:44.623685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505a0c6-01f0-46bd-94b9-33958fde844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:44.624297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505a0c6-01f0-46bd-94b9-33958fde844c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:44.624577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505a0c6-01f0-46bd-94b9-33958fde844c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:44.624849 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505a0c6-01f0-46bd-94b9-33958fde844c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:44.625707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505a0c6-01f0-46bd-94b9-33958fde844c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:44.627300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505a0c6-01f0-46bd-94b9-33958fde844c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:44.638775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1179/2371] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:40:44.643098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c4537-2b18-45c2-8198-1e9062561f78 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:44.655858 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c4537-2b18-45c2-8198-1e9062561f78 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:44.661738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebda13-1743-4034-aa6f-42d5582089c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:44.662552 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebda13-1743-4034-aa6f-42d5582089c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:44.667799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebda13-1743-4034-aa6f-42d5582089c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:44.667799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebda13-1743-4034-aa6f-42d5582089c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:44.667799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebda13-1743-4034-aa6f-42d5582089c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:44.667799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebda13-1743-4034-aa6f-42d5582089c7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:44.676015 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1193/2372] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:40:44.680562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505a0c6-01f0-46bd-94b9-33958fde844c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:44.690857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505a0c6-01f0-46bd-94b9-33958fde844c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:44.695888 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54050136-0e97-499c-a05e-c8bd7e05ea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:44.696698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54050136-0e97-499c-a05e-c8bd7e05ea66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:44.696907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54050136-0e97-499c-a05e-c8bd7e05ea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:44.697202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54050136-0e97-499c-a05e-c8bd7e05ea66 admin admin] PATH_INFO: `/v3/projects/a116091752c746f89ab2f0bd6bb53c4a/users/6d49d35f8a01434d8deeaee0782f0b57/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:44.714917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54050136-0e97-499c-a05e-c8bd7e05ea66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a116091752c746f89ab2f0bd6bb53c4a, user_id=6d49d35f8a01434d8deeaee0782f0b57, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:44.717794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54050136-0e97-499c-a05e-c8bd7e05ea66 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:44.786381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1180/2373] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:40:44 2022] PUT /identity/v3/projects/a116091752c746f89ab2f0bd6bb53c4a/users/6d49d35f8a01434d8deeaee0782f0b57/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:44.796989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c797766-3e2a-4c0d-86d9-db0674944696 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:44.797330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c797766-3e2a-4c0d-86d9-db0674944696 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:44.797607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c797766-3e2a-4c0d-86d9-db0674944696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:44.833634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7c797766-3e2a-4c0d-86d9-db0674944696 None None] MFA Rules not processed for user `6d49d35f8a01434d8deeaee0782f0b57`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:44.834981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c797766-3e2a-4c0d-86d9-db0674944696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:44.903578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1194/2374] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:44.915850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54050136-0e97-499c-a05e-c8bd7e05ea66 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:44.917600 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-54050136-0e97-499c-a05e-c8bd7e05ea66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:44.927993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:44.976942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54050136-0e97-499c-a05e-c8bd7e05ea66 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:44.981873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbd4bd-732d-4d8f-b660-a3aa24af22a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:44.982501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbd4bd-732d-4d8f-b660-a3aa24af22a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:44.983068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbd4bd-732d-4d8f-b660-a3aa24af22a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:44.983180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbd4bd-732d-4d8f-b660-a3aa24af22a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:44.992743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbd4bd-732d-4d8f-b660-a3aa24af22a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:44.994689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbd4bd-732d-4d8f-b660-a3aa24af22a3 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:45.003853 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1181/2375] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:45.030797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c797766-3e2a-4c0d-86d9-db0674944696 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:45.037643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:45.093935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c797766-3e2a-4c0d-86d9-db0674944696 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:45.098913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:45.099555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:45.099833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:45.100119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] PATH_INFO: `/v3/users/6d49d35f8a01434d8deeaee0782f0b57` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:45.101360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d49d35f8a01434d8deeaee0782f0b57)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:45.103253 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:45.289983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d49d35f8a01434d8deeaee0782f0b57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:45.290795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d49d35f8a01434d8deeaee0782f0b57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:45.350786 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d49d35f8a01434d8deeaee0782f0b57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:45.351600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d49d35f8a01434d8deeaee0782f0b57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:45.373303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d49d35f8a01434d8deeaee0782f0b57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:45.386531 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1195/2376] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:40:45 2022] DELETE /identity/v3/users/6d49d35f8a01434d8deeaee0782f0b57 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:45.390796 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8f096-40a8-443e-a4ff-e15172d2ec43 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:45.391249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8f096-40a8-443e-a4ff-e15172d2ec43 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:45.391375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8f096-40a8-443e-a4ff-e15172d2ec43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:45.413105 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-68a8f096-40a8-443e-a4ff-e15172d2ec43 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:45.418279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-68a8f096-40a8-443e-a4ff-e15172d2ec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:45.505005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1182/2377] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:45.514494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:45.515940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:45.590658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e4596-5a0e-458e-8175-b9a5d797434d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:45.594301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeae6e-e51f-493b-b988-4e96da89786c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:45.594918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeae6e-e51f-493b-b988-4e96da89786c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:45.595197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeae6e-e51f-493b-b988-4e96da89786c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:45.595472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeae6e-e51f-493b-b988-4e96da89786c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:45.605778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aeae6e-e51f-493b-b988-4e96da89786c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:45.607268 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aeae6e-e51f-493b-b988-4e96da89786c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:45.618557 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1196/2378] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:46.027255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8f096-40a8-443e-a4ff-e15172d2ec43 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:46.030196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-68a8f096-40a8-443e-a4ff-e15172d2ec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:46.044200 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8f096-40a8-443e-a4ff-e15172d2ec43 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:46.049066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:46.049763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:46.050042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:46.050315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] PATH_INFO: `/v3/projects/a116091752c746f89ab2f0bd6bb53c4a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:46.052160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a116091752c746f89ab2f0bd6bb53c4a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:46.054014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:46.219358 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a116091752c746f89ab2f0bd6bb53c4a', 'request_id': 'req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:46.226462 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a116091752c746f89ab2f0bd6bb53c4a', 'request_id': 'req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:46.235028 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a116091752c746f89ab2f0bd6bb53c4a', 'request_id': 'req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:46.328895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] The token cache is being invalidate because project a116091752c746f89ab2f0bd6bb53c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:40:46.328895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:46.329264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-35e861ca-7dbc-4aee-9e03-a8903a1ec1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:40:46.330636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1183/2379] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:40:46 2022] DELETE /identity/v3/projects/a116091752c746f89ab2f0bd6bb53c4a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:40:47.129778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cb77c-bff9-4e72-a6cb-e3e997d074c6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:47.130926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cb77c-bff9-4e72-a6cb-e3e997d074c6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:47.131033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cb77c-bff9-4e72-a6cb-e3e997d074c6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:47.132532 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1197/2380] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 05:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:40:47.138546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd89c-cda7-46b1-a2f6-b71c19445248 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:47.139010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd89c-cda7-46b1-a2f6-b71c19445248 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:47.139151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd89c-cda7-46b1-a2f6-b71c19445248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:47.159453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-84fdd89c-cda7-46b1-a2f6-b71c19445248 None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:47.160685 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-84fdd89c-cda7-46b1-a2f6-b71c19445248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:47.191876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:47.232662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1184/2381] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 05:40:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:47.244770 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cb77c-bff9-4e72-a6cb-e3e997d074c6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:47.246709 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-159cb77c-bff9-4e72-a6cb-e3e997d074c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:47.280455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:40:47.308708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cb77c-bff9-4e72-a6cb-e3e997d074c6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:47.312378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c980e4-10f8-4ba2-b678-f28338c276f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8753f3c218248abbf8018056c67b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:47.313120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c980e4-10f8-4ba2-b678-f28338c276f0 service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:47.313303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c980e4-10f8-4ba2-b678-f28338c276f0 service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:47.313580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c980e4-10f8-4ba2-b678-f28338c276f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:47.324224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c980e4-10f8-4ba2-b678-f28338c276f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:47.327774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c980e4-10f8-4ba2-b678-f28338c276f0 service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:47.336677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1198/2382] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:47.587465 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586c3e9-84ed-473e-a484-fa2eed3c788c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:47.587872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586c3e9-84ed-473e-a484-fa2eed3c788c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:47.588151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586c3e9-84ed-473e-a484-fa2eed3c788c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:47.589543 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1185/2383] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 05:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:40:47.594645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafeff1-2488-4d54-9459-cd785487d336 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:47.594929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafeff1-2488-4d54-9459-cd785487d336 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:47.595233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafeff1-2488-4d54-9459-cd785487d336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:47.616634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2aafeff1-2488-4d54-9459-cd785487d336 None None] MFA Rules not processed for user `76596e04e82b43cb8b68ee2f5e6dd9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:47.617856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2aafeff1-2488-4d54-9459-cd785487d336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:47.673601 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1199/2384] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 05:40:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:47.685778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586c3e9-84ed-473e-a484-fa2eed3c788c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:47.687997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d586c3e9-84ed-473e-a484-fa2eed3c788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:47.701519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586c3e9-84ed-473e-a484-fa2eed3c788c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:47.705368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2693e8a-99a0-412a-8533-765b66467bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:47.706106 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2693e8a-99a0-412a-8533-765b66467bdc service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:47.706449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2693e8a-99a0-412a-8533-765b66467bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:47.706788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2693e8a-99a0-412a-8533-765b66467bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:47.715246 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2693e8a-99a0-412a-8533-765b66467bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:47.716696 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2693e8a-99a0-412a-8533-765b66467bdc service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:47.725459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1186/2385] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:47.812485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d739-6af0-4dde-9cbb-7a734e91b9cf None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:47.812803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d739-6af0-4dde-9cbb-7a734e91b9cf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:47.813249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d739-6af0-4dde-9cbb-7a734e91b9cf None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:47.814666 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1200/2386] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 05:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 05:40:47.820469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27bdf-ea56-4b57-8cad-b0b02a2d2753 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:47.820758 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27bdf-ea56-4b57-8cad-b0b02a2d2753 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:47.821083 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27bdf-ea56-4b57-8cad-b0b02a2d2753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:47.840897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-42b27bdf-ea56-4b57-8cad-b0b02a2d2753 None None] MFA Rules not processed for user `531ebc9dee0440888b94a6bf17d7a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:47.842129 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-42b27bdf-ea56-4b57-8cad-b0b02a2d2753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:47.852245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1187/2387] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 05:40:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:40:47.862546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518d739-6af0-4dde-9cbb-7a734e91b9cf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:47.864252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c518d739-6af0-4dde-9cbb-7a734e91b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:47.878057 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518d739-6af0-4dde-9cbb-7a734e91b9cf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:47.882592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3e96c-66fd-4f8e-a07f-43f0814006c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:47.883187 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3e96c-66fd-4f8e-a07f-43f0814006c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:47.883465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3e96c-66fd-4f8e-a07f-43f0814006c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:47.883735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3e96c-66fd-4f8e-a07f-43f0814006c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:47.894136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3e96c-66fd-4f8e-a07f-43f0814006c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:47.896407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3e96c-66fd-4f8e-a07f-43f0814006c2 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:47.912144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1201/2388] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:40:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:40:51.464115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2e245-c7bb-42c4-b8a2-8edc210168a3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:51.464587 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2e245-c7bb-42c4-b8a2-8edc210168a3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:51.464763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2e245-c7bb-42c4-b8a2-8edc210168a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:51.485796 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-70b2e245-c7bb-42c4-b8a2-8edc210168a3 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:40:51.486996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-70b2e245-c7bb-42c4-b8a2-8edc210168a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:51.541313 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1188/2389] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:40:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:40:51.553784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3e96c-66fd-4f8e-a07f-43f0814006c2 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:40:51.555204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f7f3e96c-66fd-4f8e-a07f-43f0814006c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:40:51.623377 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3e96c-66fd-4f8e-a07f-43f0814006c2 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:40:51.628366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630516e2-840e-4ca9-91e0-c03e28e748fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:40:51.628917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630516e2-840e-4ca9-91e0-c03e28e748fa service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:40:51.629225 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630516e2-840e-4ca9-91e0-c03e28e748fa service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:40:51.629500 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630516e2-840e-4ca9-91e0-c03e28e748fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:40:51.638497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630516e2-840e-4ca9-91e0-c03e28e748fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:40:51.640075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630516e2-840e-4ca9-91e0-c03e28e748fa service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:40:51.649441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1202/2390] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:40:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:41:01.534302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=50 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:01.645550 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=75 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:12.862440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2e245-c7bb-42c4-b8a2-8edc210168a3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:41:12.863870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-70b2e245-c7bb-42c4-b8a2-8edc210168a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:12.950183 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2e245-c7bb-42c4-b8a2-8edc210168a3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:41:12.955704 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f90bd-eebd-4927-a425-a2f75614f0fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5593bc41bce41b4b44616c355976cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:41:12.956421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f90bd-eebd-4927-a425-a2f75614f0fa service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:41:12.956700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f90bd-eebd-4927-a425-a2f75614f0fa service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:41:12.956969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f90bd-eebd-4927-a425-a2f75614f0fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:41:12.958977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ac8f90bd-eebd-4927-a425-a2f75614f0fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:12.971809 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f90bd-eebd-4927-a425-a2f75614f0fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:41:12.973747 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f90bd-eebd-4927-a425-a2f75614f0fa service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:41:12.984722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1189/2391] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:41:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:41:14.620643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630516e2-840e-4ca9-91e0-c03e28e748fa service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:41:14.622787 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-630516e2-840e-4ca9-91e0-c03e28e748fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:14.755571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630516e2-840e-4ca9-91e0-c03e28e748fa service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:41:14.761553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:41:14.762480 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:41:14.763039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:41:14.763418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] PATH_INFO: `/v3/users/33d22d597a28470daad409458979bf1b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:41:14.765096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d22d597a28470daad409458979bf1b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:41:14.767405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:41:15.017545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d22d597a28470daad409458979bf1b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:41:15.018267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d22d597a28470daad409458979bf1b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:41:15.105710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d22d597a28470daad409458979bf1b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:41:15.106335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d22d597a28470daad409458979bf1b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:41:15.120750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d22d597a28470daad409458979bf1b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:41:15.132795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1203/2392] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:41:14 2022] DELETE /identity/v3/users/33d22d597a28470daad409458979bf1b => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:41:15.137310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e9ee0-2cd4-4de7-a1eb-76eab66091c9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:41:15.137885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e9ee0-2cd4-4de7-a1eb-76eab66091c9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:41:15.137885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e9ee0-2cd4-4de7-a1eb-76eab66091c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:41:15.157376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-974e9ee0-2cd4-4de7-a1eb-76eab66091c9 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:41:15.158583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-974e9ee0-2cd4-4de7-a1eb-76eab66091c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:15.217269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1190/2393] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:41:15.227167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:41:15.228587 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:15.288934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe952-3835-4f6b-aa5d-e780fe86ffbe admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:41:15.293152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64765d6-7db3-40b7-8b09-8c74bd986d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:41:15.293777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64765d6-7db3-40b7-8b09-8c74bd986d24 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:41:15.294059 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64765d6-7db3-40b7-8b09-8c74bd986d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:41:15.294332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64765d6-7db3-40b7-8b09-8c74bd986d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:41:15.303560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64765d6-7db3-40b7-8b09-8c74bd986d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:41:15.304994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64765d6-7db3-40b7-8b09-8c74bd986d24 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:41:15.314621 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1204/2394] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:41:15.746949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e9ee0-2cd4-4de7-a1eb-76eab66091c9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:41:15.748418 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-974e9ee0-2cd4-4de7-a1eb-76eab66091c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:15.761859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e9ee0-2cd4-4de7-a1eb-76eab66091c9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:41:15.766055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:41:15.766790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:41:15.767020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:41:15.767378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] PATH_INFO: `/v3/projects/1186d6b17b0348318e11615a9cdb636d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:41:15.768478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1186d6b17b0348318e11615a9cdb636d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:41:15.770572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:41:15.913068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1186d6b17b0348318e11615a9cdb636d', 'request_id': 'req-56f4215a-78e0-452a-89ba-53bc3ef980a4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:41:15.920500 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1186d6b17b0348318e11615a9cdb636d', 'request_id': 'req-56f4215a-78e0-452a-89ba-53bc3ef980a4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:41:15.926136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1186d6b17b0348318e11615a9cdb636d', 'request_id': 'req-56f4215a-78e0-452a-89ba-53bc3ef980a4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:41:16.022530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] The token cache is being invalidate because project 1186d6b17b0348318e11615a9cdb636d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:41:16.022737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:41:16.028859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:41:16.030781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1191/2395] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:41:15 2022] DELETE /identity/v3/projects/1186d6b17b0348318e11615a9cdb636d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:41:17.268929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c0451-5484-4609-b25b-886463a29052 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:41:17.269433 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c0451-5484-4609-b25b-886463a29052 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:41:17.269592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c0451-5484-4609-b25b-886463a29052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:41:17.289761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-929c0451-5484-4609-b25b-886463a29052 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:41:17.291473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-929c0451-5484-4609-b25b-886463a29052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:17.308876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:17.346397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1205/2396] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 05:41:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:41:17.369146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:41:17.371190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:17.385384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:17.441278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4215a-78e0-452a-89ba-53bc3ef980a4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:41:17.446141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c5f47-04c0-4fc9-b4c1-a2fb4c188776 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:41:17.446802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c5f47-04c0-4fc9-b4c1-a2fb4c188776 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:41:17.447087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c5f47-04c0-4fc9-b4c1-a2fb4c188776 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:41:17.447359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c5f47-04c0-4fc9-b4c1-a2fb4c188776 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:41:17.455478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c5f47-04c0-4fc9-b4c1-a2fb4c188776 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:41:17.457072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c5f47-04c0-4fc9-b4c1-a2fb4c188776 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:41:17.466290 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1192/2397] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:41:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 05:41:27.396601 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=15 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:27.505265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=26 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:27.834388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da464f8-2c8f-4e7f-a82d-ee914670a436 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:41:27.834675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da464f8-2c8f-4e7f-a82d-ee914670a436 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:41:27.834952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da464f8-2c8f-4e7f-a82d-ee914670a436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:41:27.854528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0da464f8-2c8f-4e7f-a82d-ee914670a436 None None] MFA Rules not processed for user `e728ae311b604bbcaf41f91562bffbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:41:27.855776 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0da464f8-2c8f-4e7f-a82d-ee914670a436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:27.910643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1206/2398] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:41:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:41:37.903556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=25 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:41:46.861007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf3d8e-e9fb-420a-b619-077931fd4caa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:41:46.861566 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf3d8e-e9fb-420a-b619-077931fd4caa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:41:46.861669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf3d8e-e9fb-420a-b619-077931fd4caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:41:46.880986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-26bf3d8e-e9fb-420a-b619-077931fd4caa None None] MFA Rules not processed for user `69a74a81980947d9a2499a4d9ad65823`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:41:46.882194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-26bf3d8e-e9fb-420a-b619-077931fd4caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:41:46.935813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1193/2399] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:41:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:41:56.929437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=25 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:01.359218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa771-a130-4564-962c-f0421f2939e3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:01.360320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa771-a130-4564-962c-f0421f2939e3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:01.360320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fa771-a130-4564-962c-f0421f2939e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:01.379932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-630fa771-a130-4564-962c-f0421f2939e3 None None] MFA Rules not processed for user `9b14f38f371b405f915a7a9ba8c61569`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:42:01.384242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-630fa771-a130-4564-962c-f0421f2939e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:01.436338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1207/2400] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:42:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:42:11.429718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=25 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:38.478874 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3dd20-07e3-4cba-b8dd-d48956bcc146 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:38.479390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3dd20-07e3-4cba-b8dd-d48956bcc146 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:38.479495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3dd20-07e3-4cba-b8dd-d48956bcc146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:38.498340 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8ad3dd20-07e3-4cba-b8dd-d48956bcc146 None None] MFA Rules not processed for user `e728ae311b604bbcaf41f91562bffbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:42:38.499545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8ad3dd20-07e3-4cba-b8dd-d48956bcc146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:38.506950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1194/2401] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:42:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:42:48.493359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:56.036219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fa771-a130-4564-962c-f0421f2939e3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:56.038366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-630fa771-a130-4564-962c-f0421f2939e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:56.131939 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fa771-a130-4564-962c-f0421f2939e3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:56.140685 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4416186-5638-4368-93ab-224c7b830ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:56.142357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416186-5638-4368-93ab-224c7b830ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:56.142637 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416186-5638-4368-93ab-224c7b830ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:56.143849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416186-5638-4368-93ab-224c7b830ce4 admin admin] PATH_INFO: `/v3/users/69a74a81980947d9a2499a4d9ad65823` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:56.145090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4416186-5638-4368-93ab-224c7b830ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a74a81980947d9a2499a4d9ad65823)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:56.148281 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4416186-5638-4368-93ab-224c7b830ce4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:56.324430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c4416186-5638-4368-93ab-224c7b830ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a74a81980947d9a2499a4d9ad65823'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:42:56.324430 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c4416186-5638-4368-93ab-224c7b830ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a74a81980947d9a2499a4d9ad65823'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:42:56.398245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c4416186-5638-4368-93ab-224c7b830ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a74a81980947d9a2499a4d9ad65823'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:42:56.398982 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c4416186-5638-4368-93ab-224c7b830ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a74a81980947d9a2499a4d9ad65823'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:42:56.419065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c4416186-5638-4368-93ab-224c7b830ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a74a81980947d9a2499a4d9ad65823'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:42:56.437363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1208/2402] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:42:56 2022] DELETE /identity/v3/users/69a74a81980947d9a2499a4d9ad65823 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:42:56.777977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3dd20-07e3-4cba-b8dd-d48956bcc146 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:56.792610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3dd20-07e3-4cba-b8dd-d48956bcc146 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:56.854476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:56.855123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:56.855407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:56.855679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] PATH_INFO: `/v3/projects/87ff893dfd7f43b8bbca71ea23907860` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:56.856827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ff893dfd7f43b8bbca71ea23907860)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:56.858795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:56.954833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ff893dfd7f43b8bbca71ea23907860', 'request_id': 'req-1febf269-5a5e-4236-8eb1-005cafca6205'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:42:56.961667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ff893dfd7f43b8bbca71ea23907860', 'request_id': 'req-1febf269-5a5e-4236-8eb1-005cafca6205'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:42:56.967745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ff893dfd7f43b8bbca71ea23907860', 'request_id': 'req-1febf269-5a5e-4236-8eb1-005cafca6205'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:42:57.027967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] The token cache is being invalidate because project 87ff893dfd7f43b8bbca71ea23907860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:42:57.028263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:42:57.028881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1febf269-5a5e-4236-8eb1-005cafca6205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:42:57.030511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1195/2403] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:42:56 2022] DELETE /identity/v3/projects/87ff893dfd7f43b8bbca71ea23907860 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:42:57.035749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8751457-381a-42c9-84ee-7ca1f760a6cd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:57.036038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8751457-381a-42c9-84ee-7ca1f760a6cd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:57.036317 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8751457-381a-42c9-84ee-7ca1f760a6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:57.058052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e8751457-381a-42c9-84ee-7ca1f760a6cd None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:42:57.061251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e8751457-381a-42c9-84ee-7ca1f760a6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:57.132605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1209/2404] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:42:57.140304 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed6ad1-acde-462e-9ade-dc82e47bcc9e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:57.140589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed6ad1-acde-462e-9ade-dc82e47bcc9e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:57.140862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed6ad1-acde-462e-9ade-dc82e47bcc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:57.167954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-65ed6ad1-acde-462e-9ade-dc82e47bcc9e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:42:57.169431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-65ed6ad1-acde-462e-9ade-dc82e47bcc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:57.177833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1196/2405] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:42:57.182363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8751457-381a-42c9-84ee-7ca1f760a6cd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:57.192312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8751457-381a-42c9-84ee-7ca1f760a6cd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:57.197707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34b103-755e-43e1-a95a-e58fc51fe3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:57.198324 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b103-755e-43e1-a95a-e58fc51fe3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:57.198607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b103-755e-43e1-a95a-e58fc51fe3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:57.198882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b103-755e-43e1-a95a-e58fc51fe3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:57.199586 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34b103-755e-43e1-a95a-e58fc51fe3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:42:57.199890 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34b103-755e-43e1-a95a-e58fc51fe3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:57.201521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34b103-755e-43e1-a95a-e58fc51fe3a4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:57.214078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1210/2406] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:42:57.218142 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed6ad1-acde-462e-9ade-dc82e47bcc9e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:57.228029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed6ad1-acde-462e-9ade-dc82e47bcc9e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:57.232576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f1e35-9f09-46ae-b73f-8c684904e68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:57.233226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1e35-9f09-46ae-b73f-8c684904e68e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:57.233509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1e35-9f09-46ae-b73f-8c684904e68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:57.233779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1e35-9f09-46ae-b73f-8c684904e68e admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:57.234461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f1e35-9f09-46ae-b73f-8c684904e68e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:57.236366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f1e35-9f09-46ae-b73f-8c684904e68e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:57.312956 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1197/2407] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:42:57 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:42:57.314376 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34b103-755e-43e1-a95a-e58fc51fe3a4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:57.324547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34b103-755e-43e1-a95a-e58fc51fe3a4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:57.328209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:57.387275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9a1c5-98ee-4f1c-addd-1b8ccfe24e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:57.387903 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9a1c5-98ee-4f1c-addd-1b8ccfe24e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:57.388189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9a1c5-98ee-4f1c-addd-1b8ccfe24e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:57.388459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9a1c5-98ee-4f1c-addd-1b8ccfe24e00 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:57.389148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9a1c5-98ee-4f1c-addd-1b8ccfe24e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:57.391075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9a1c5-98ee-4f1c-addd-1b8ccfe24e00 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:57.477205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1211/2408] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:42:57 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:42:57.478921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f1e35-9f09-46ae-b73f-8c684904e68e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:57.489597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f1e35-9f09-46ae-b73f-8c684904e68e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:57.494512 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2287a9-1ab3-41f4-8e78-c81cc0c58d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:57.495239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2287a9-1ab3-41f4-8e78-c81cc0c58d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:57.495567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2287a9-1ab3-41f4-8e78-c81cc0c58d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:57.496070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2287a9-1ab3-41f4-8e78-c81cc0c58d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:57.496687 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2287a9-1ab3-41f4-8e78-c81cc0c58d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:57.498317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2287a9-1ab3-41f4-8e78-c81cc0c58d61 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:57.509096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1198/2409] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:42:57.513466 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9a1c5-98ee-4f1c-addd-1b8ccfe24e00 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:57.524432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9a1c5-98ee-4f1c-addd-1b8ccfe24e00 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:57.529287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e26fc-7e1e-4f7d-b711-ae641acf1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:57.529962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e26fc-7e1e-4f7d-b711-ae641acf1a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:57.530183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e26fc-7e1e-4f7d-b711-ae641acf1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:57.530456 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e26fc-7e1e-4f7d-b711-ae641acf1a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:57.531154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e26fc-7e1e-4f7d-b711-ae641acf1a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:57.532759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e26fc-7e1e-4f7d-b711-ae641acf1a36 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:57.544984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1212/2410] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:42:57.554054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2287a9-1ab3-41f4-8e78-c81cc0c58d61 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:57.564013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2287a9-1ab3-41f4-8e78-c81cc0c58d61 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:57.568832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3225f-481f-4621-9a3c-791057588950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:57.569687 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3225f-481f-4621-9a3c-791057588950 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:57.569957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3225f-481f-4621-9a3c-791057588950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:57.570302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3225f-481f-4621-9a3c-791057588950 admin admin] PATH_INFO: `/v3/projects/5c59c1f081b74e78b60364e7a701e129/users/da7325bdd4734bd38e45fbf74a837fc1/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:57.586449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3225f-481f-4621-9a3c-791057588950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c59c1f081b74e78b60364e7a701e129, user_id=da7325bdd4734bd38e45fbf74a837fc1, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:57.589400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3225f-481f-4621-9a3c-791057588950 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:57.657393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1199/2411] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:42:57 2022] PUT /identity/v3/projects/5c59c1f081b74e78b60364e7a701e129/users/da7325bdd4734bd38e45fbf74a837fc1/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:42:57.663495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ddee-1c6a-42cf-ab39-9c1262158552 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:57.663783 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ddee-1c6a-42cf-ab39-9c1262158552 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:57.664062 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ddee-1c6a-42cf-ab39-9c1262158552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:57.684712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6868ddee-1c6a-42cf-ab39-9c1262158552 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:42:57.685948 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6868ddee-1c6a-42cf-ab39-9c1262158552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:57.755971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1213/2412] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:42:57.766500 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3225f-481f-4621-9a3c-791057588950 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:42:57.768345 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0bf3225f-481f-4621-9a3c-791057588950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:42:57.803257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:42:57.841368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3225f-481f-4621-9a3c-791057588950 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:42:57.848871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa63deb-16db-4719-a8c4-1c4e3afacf46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:42:57.849973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63deb-16db-4719-a8c4-1c4e3afacf46 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:42:57.851456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63deb-16db-4719-a8c4-1c4e3afacf46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:42:57.852323 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63deb-16db-4719-a8c4-1c4e3afacf46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:42:57.866086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa63deb-16db-4719-a8c4-1c4e3afacf46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:42:57.868479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa63deb-16db-4719-a8c4-1c4e3afacf46 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:42:57.881950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1200/2413] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:43:03.093782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ddee-1c6a-42cf-ab39-9c1262158552 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:03.105722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ddee-1c6a-42cf-ab39-9c1262158552 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:03.110493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161b7a7-0bbf-4756-882f-8bb980260632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:03.111136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161b7a7-0bbf-4756-882f-8bb980260632 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:03.111417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161b7a7-0bbf-4756-882f-8bb980260632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:03.111692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161b7a7-0bbf-4756-882f-8bb980260632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:03.113735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0161b7a7-0bbf-4756-882f-8bb980260632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:03.218710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161b7a7-0bbf-4756-882f-8bb980260632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:03.220379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161b7a7-0bbf-4756-882f-8bb980260632 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:03.248429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1214/2414] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:43:03.601511 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a1153-8fcf-4944-b045-771b22808c5a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:03.602021 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a1153-8fcf-4944-b045-771b22808c5a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:03.602103 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a1153-8fcf-4944-b045-771b22808c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:03.634124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fa9a1153-8fcf-4944-b045-771b22808c5a None None] MFA Rules not processed for user `da7325bdd4734bd38e45fbf74a837fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:43:03.635333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa9a1153-8fcf-4944-b045-771b22808c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:03.705597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1201/2415] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:43:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:43:03.719884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161b7a7-0bbf-4756-882f-8bb980260632 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:03.721410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0161b7a7-0bbf-4756-882f-8bb980260632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:03.735850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161b7a7-0bbf-4756-882f-8bb980260632 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:03.744459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9ae9e-9feb-468a-b61d-cad0e9961a6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:03.750340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9ae9e-9feb-468a-b61d-cad0e9961a6d service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:03.750340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9ae9e-9feb-468a-b61d-cad0e9961a6d service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:03.750340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9ae9e-9feb-468a-b61d-cad0e9961a6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:03.771074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9ae9e-9feb-468a-b61d-cad0e9961a6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:03.773585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9ae9e-9feb-468a-b61d-cad0e9961a6d service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:03.777508 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:03.783632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1215/2416] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:43:05.686876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a1153-8fcf-4944-b045-771b22808c5a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:05.688420 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa9a1153-8fcf-4944-b045-771b22808c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:05.701599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a1153-8fcf-4944-b045-771b22808c5a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:05.705302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321ac9f-c2ba-4cee-8669-43775342191a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:05.706123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321ac9f-c2ba-4cee-8669-43775342191a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:05.706560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321ac9f-c2ba-4cee-8669-43775342191a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:05.706994 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321ac9f-c2ba-4cee-8669-43775342191a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:05.708826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8321ac9f-c2ba-4cee-8669-43775342191a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:05.727196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321ac9f-c2ba-4cee-8669-43775342191a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:05.731691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321ac9f-c2ba-4cee-8669-43775342191a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:05.745794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1202/2417] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:43:06.053892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7828e-b82a-482c-8d9e-a996f350fa44 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:06.054840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7828e-b82a-482c-8d9e-a996f350fa44 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:06.055318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7828e-b82a-482c-8d9e-a996f350fa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:06.074764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d4a7828e-b82a-482c-8d9e-a996f350fa44 None None] MFA Rules not processed for user `da7325bdd4734bd38e45fbf74a837fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:43:06.075958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d4a7828e-b82a-482c-8d9e-a996f350fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:06.082799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1216/2418] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:43:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:43:14.287221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6153fa-39da-4d99-9b19-fcbe9b194233 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:14.288295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6153fa-39da-4d99-9b19-fcbe9b194233 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:14.288295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6153fa-39da-4d99-9b19-fcbe9b194233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:14.309259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7c6153fa-39da-4d99-9b19-fcbe9b194233 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:43:14.310487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7c6153fa-39da-4d99-9b19-fcbe9b194233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:14.376042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1203/2419] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:43:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:43:14.501799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7828e-b82a-482c-8d9e-a996f350fa44 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:14.503298 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d4a7828e-b82a-482c-8d9e-a996f350fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:14.574051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7828e-b82a-482c-8d9e-a996f350fa44 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:14.579033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabf6de-c250-4dd5-8039-5b80dae09958 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:14.579644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabf6de-c250-4dd5-8039-5b80dae09958 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:14.579928 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabf6de-c250-4dd5-8039-5b80dae09958 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:14.580197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabf6de-c250-4dd5-8039-5b80dae09958 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:14.588772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabf6de-c250-4dd5-8039-5b80dae09958 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:14.590386 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabf6de-c250-4dd5-8039-5b80dae09958 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:14.599160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1217/2420] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:43:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:43:17.915322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6153fa-39da-4d99-9b19-fcbe9b194233 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:17.917480 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7c6153fa-39da-4d99-9b19-fcbe9b194233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:17.941347 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6153fa-39da-4d99-9b19-fcbe9b194233 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:17.950087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e125cc-df56-4697-b557-ed2720785b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:17.951241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e125cc-df56-4697-b557-ed2720785b18 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:17.951752 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e125cc-df56-4697-b557-ed2720785b18 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:17.952245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e125cc-df56-4697-b557-ed2720785b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:17.955246 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a9e125cc-df56-4697-b557-ed2720785b18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:18.016757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:18.035917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e125cc-df56-4697-b557-ed2720785b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:18.039445 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e125cc-df56-4697-b557-ed2720785b18 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:18.052155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1204/2421] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:43:24.595303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=36 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:28.186287 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:30.794227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabf6de-c250-4dd5-8039-5b80dae09958 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:30.803545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabf6de-c250-4dd5-8039-5b80dae09958 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:30.813331 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087707-47b8-4919-95d1-671894b91b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:30.813960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087707-47b8-4919-95d1-671894b91b04 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:30.814245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087707-47b8-4919-95d1-671894b91b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:30.814523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087707-47b8-4919-95d1-671894b91b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:30.816339 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a087707-47b8-4919-95d1-671894b91b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:30.826546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a087707-47b8-4919-95d1-671894b91b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:30.827965 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a087707-47b8-4919-95d1-671894b91b04 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:30.836000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1218/2422] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:43:31.514761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e125cc-df56-4697-b557-ed2720785b18 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:31.516202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a9e125cc-df56-4697-b557-ed2720785b18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:31.583899 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e125cc-df56-4697-b557-ed2720785b18 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:31.588948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db48a81-1c9b-4009-b8ca-cb11f4c5f2db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5593bc41bce41b4b44616c355976cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:31.589597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db48a81-1c9b-4009-b8ca-cb11f4c5f2db service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:31.589905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db48a81-1c9b-4009-b8ca-cb11f4c5f2db service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:31.590176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db48a81-1c9b-4009-b8ca-cb11f4c5f2db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:31.591982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0db48a81-1c9b-4009-b8ca-cb11f4c5f2db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:31.603092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db48a81-1c9b-4009-b8ca-cb11f4c5f2db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:31.604700 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db48a81-1c9b-4009-b8ca-cb11f4c5f2db service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:31.615150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1205/2423] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:43:32.834330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087707-47b8-4919-95d1-671894b91b04 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:32.843423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087707-47b8-4919-95d1-671894b91b04 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:32.847063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d614a-84ae-4fb1-8cd8-0629d4d09678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:32.847668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d614a-84ae-4fb1-8cd8-0629d4d09678 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:32.847950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d614a-84ae-4fb1-8cd8-0629d4d09678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:32.848224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d614a-84ae-4fb1-8cd8-0629d4d09678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:32.849998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-307d614a-84ae-4fb1-8cd8-0629d4d09678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:32.860114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d614a-84ae-4fb1-8cd8-0629d4d09678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:32.861577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d614a-84ae-4fb1-8cd8-0629d4d09678 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:32.869778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1219/2424] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:43:33.990419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d6c38-b063-4f0a-b521-4c4e584d9b39 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:33.990873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d6c38-b063-4f0a-b521-4c4e584d9b39 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:33.990966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d6c38-b063-4f0a-b521-4c4e584d9b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:34.009630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-735d6c38-b063-4f0a-b521-4c4e584d9b39 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:43:34.010843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-735d6c38-b063-4f0a-b521-4c4e584d9b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:34.018363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1206/2425] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:43:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:43:34.030571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d614a-84ae-4fb1-8cd8-0629d4d09678 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:34.042894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d614a-84ae-4fb1-8cd8-0629d4d09678 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:34.048511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907c979-4bd2-422c-8a10-28022d51d1cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:34.049118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907c979-4bd2-422c-8a10-28022d51d1cd service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:34.049444 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907c979-4bd2-422c-8a10-28022d51d1cd service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:34.049721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907c979-4bd2-422c-8a10-28022d51d1cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:34.057747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907c979-4bd2-422c-8a10-28022d51d1cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:34.059332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907c979-4bd2-422c-8a10-28022d51d1cd service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:34.067526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1220/2426] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:43:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:43:36.324339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d6c38-b063-4f0a-b521-4c4e584d9b39 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:36.338411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d6c38-b063-4f0a-b521-4c4e584d9b39 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:36.349390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119ac9b-a49e-432b-9b53-46b947ecc999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:36.350182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ac9b-a49e-432b-9b53-46b947ecc999 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:36.350475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ac9b-a49e-432b-9b53-46b947ecc999 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:36.350724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ac9b-a49e-432b-9b53-46b947ecc999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:36.352568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8119ac9b-a49e-432b-9b53-46b947ecc999 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:36.418205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119ac9b-a49e-432b-9b53-46b947ecc999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:36.420184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119ac9b-a49e-432b-9b53-46b947ecc999 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:36.430037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1207/2427] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:43:44.064120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=18 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:46.425423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=63 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:43:50.992309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907c979-4bd2-422c-8a10-28022d51d1cd service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:51.004505 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907c979-4bd2-422c-8a10-28022d51d1cd service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:51.010056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc8581-6bf1-45bc-9d93-322474a76a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:51.010670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc8581-6bf1-45bc-9d93-322474a76a12 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:51.010949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc8581-6bf1-45bc-9d93-322474a76a12 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:51.011285 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc8581-6bf1-45bc-9d93-322474a76a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:51.013843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-59bc8581-6bf1-45bc-9d93-322474a76a12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:51.027314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc8581-6bf1-45bc-9d93-322474a76a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:51.029037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc8581-6bf1-45bc-9d93-322474a76a12 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:51.042483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1221/2428] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:43:51.318382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3f59e-48bc-41b2-a00f-0cd2bde0bedd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:51.318886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3f59e-48bc-41b2-a00f-0cd2bde0bedd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:51.318981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3f59e-48bc-41b2-a00f-0cd2bde0bedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:51.340271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0cf3f59e-48bc-41b2-a00f-0cd2bde0bedd None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:43:51.341539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0cf3f59e-48bc-41b2-a00f-0cd2bde0bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:51.349110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1208/2429] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 05:43:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:43:51.361436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc8581-6bf1-45bc-9d93-322474a76a12 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:51.374212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc8581-6bf1-45bc-9d93-322474a76a12 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:51.379239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a6978-e804-49ce-a78b-635ca19979a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:51.379845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6978-e804-49ce-a78b-635ca19979a8 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:51.380126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6978-e804-49ce-a78b-635ca19979a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:51.380389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a6978-e804-49ce-a78b-635ca19979a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:51.389502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a6978-e804-49ce-a78b-635ca19979a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:51.391075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a6978-e804-49ce-a78b-635ca19979a8 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:51.399728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1222/2430] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:43:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:43:57.846992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3f59e-48bc-41b2-a00f-0cd2bde0bedd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:43:57.856269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3f59e-48bc-41b2-a00f-0cd2bde0bedd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:43:57.860498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23791a66-5627-4546-9bba-07f1d5bd6c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:43:57.861106 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23791a66-5627-4546-9bba-07f1d5bd6c59 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:43:57.861438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23791a66-5627-4546-9bba-07f1d5bd6c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:43:57.861713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23791a66-5627-4546-9bba-07f1d5bd6c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:43:57.863453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-23791a66-5627-4546-9bba-07f1d5bd6c59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:43:57.875816 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23791a66-5627-4546-9bba-07f1d5bd6c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:43:57.877265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23791a66-5627-4546-9bba-07f1d5bd6c59 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:43:57.886926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1209/2431] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:01.397170 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=12 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:01.684438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a6978-e804-49ce-a78b-635ca19979a8 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:01.686419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a48a6978-e804-49ce-a78b-635ca19979a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:01.702054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a6978-e804-49ce-a78b-635ca19979a8 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:01.706976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520b919-5052-4cf2-8a59-41f3a0ea84fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:01.707719 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520b919-5052-4cf2-8a59-41f3a0ea84fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:01.707878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520b919-5052-4cf2-8a59-41f3a0ea84fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:01.708347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520b919-5052-4cf2-8a59-41f3a0ea84fc admin admin] PATH_INFO: `/v3/users/e728ae311b604bbcaf41f91562bffbc3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:01.709544 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520b919-5052-4cf2-8a59-41f3a0ea84fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e728ae311b604bbcaf41f91562bffbc3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:01.711446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520b919-5052-4cf2-8a59-41f3a0ea84fc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:01.918233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c520b919-5052-4cf2-8a59-41f3a0ea84fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e728ae311b604bbcaf41f91562bffbc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:01.918877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c520b919-5052-4cf2-8a59-41f3a0ea84fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e728ae311b604bbcaf41f91562bffbc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:02.005908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c520b919-5052-4cf2-8a59-41f3a0ea84fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e728ae311b604bbcaf41f91562bffbc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:02.006533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c520b919-5052-4cf2-8a59-41f3a0ea84fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e728ae311b604bbcaf41f91562bffbc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:02.020116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c520b919-5052-4cf2-8a59-41f3a0ea84fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e728ae311b604bbcaf41f91562bffbc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:02.033460 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1223/2432] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:01 2022] DELETE /identity/v3/users/e728ae311b604bbcaf41f91562bffbc3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:02.321433 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23791a66-5627-4546-9bba-07f1d5bd6c59 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:02.332667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23791a66-5627-4546-9bba-07f1d5bd6c59 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:02.392211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:02.392854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:02.393154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:02.393422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] PATH_INFO: `/v3/projects/e02ec0c5f32b4d1689660c67cb8de41f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:02.394576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02ec0c5f32b4d1689660c67cb8de41f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:02.396636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:02.491792 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02ec0c5f32b4d1689660c67cb8de41f', 'request_id': 'req-c060a3a9-1940-4e33-b5ca-fa29910ad555'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:02.498560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02ec0c5f32b4d1689660c67cb8de41f', 'request_id': 'req-c060a3a9-1940-4e33-b5ca-fa29910ad555'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:02.504214 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02ec0c5f32b4d1689660c67cb8de41f', 'request_id': 'req-c060a3a9-1940-4e33-b5ca-fa29910ad555'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:02.597778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] The token cache is being invalidate because project e02ec0c5f32b4d1689660c67cb8de41f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:02.598316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:02.598951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c060a3a9-1940-4e33-b5ca-fa29910ad555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:02.600516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1210/2433] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:02 2022] DELETE /identity/v3/projects/e02ec0c5f32b4d1689660c67cb8de41f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:02.605427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e70d7-e12d-4b72-993b-1d2c2ba6c4a3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:02.607476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e70d7-e12d-4b72-993b-1d2c2ba6c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:02.607476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e70d7-e12d-4b72-993b-1d2c2ba6c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:02.625877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-573e70d7-e12d-4b72-993b-1d2c2ba6c4a3 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:02.627062 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-573e70d7-e12d-4b72-993b-1d2c2ba6c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:02.688287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1224/2434] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:02.696901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30664f-d6b7-4666-87ea-c43c028869d5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:02.697226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30664f-d6b7-4666-87ea-c43c028869d5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:02.697495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30664f-d6b7-4666-87ea-c43c028869d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:02.717775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5b30664f-d6b7-4666-87ea-c43c028869d5 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:02.718982 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5b30664f-d6b7-4666-87ea-c43c028869d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:02.726953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1211/2435] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:02.731182 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e70d7-e12d-4b72-993b-1d2c2ba6c4a3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:02.741487 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e70d7-e12d-4b72-993b-1d2c2ba6c4a3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:02.746227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335f6b-39e1-430a-8386-a6728918020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:02.746841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335f6b-39e1-430a-8386-a6728918020c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:02.747121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335f6b-39e1-430a-8386-a6728918020c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:02.747396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335f6b-39e1-430a-8386-a6728918020c admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:02.748615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335f6b-39e1-430a-8386-a6728918020c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:44:02.748911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335f6b-39e1-430a-8386-a6728918020c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:02.750554 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335f6b-39e1-430a-8386-a6728918020c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:02.762960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1225/2436] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:44:02.767402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30664f-d6b7-4666-87ea-c43c028869d5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:02.776894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30664f-d6b7-4666-87ea-c43c028869d5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:02.781615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9903b3f-6fca-4573-a7dd-3fddfa4299b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:02.782224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9903b3f-6fca-4573-a7dd-3fddfa4299b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:02.782508 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9903b3f-6fca-4573-a7dd-3fddfa4299b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:02.782780 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9903b3f-6fca-4573-a7dd-3fddfa4299b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:02.783441 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9903b3f-6fca-4573-a7dd-3fddfa4299b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:02.785362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9903b3f-6fca-4573-a7dd-3fddfa4299b7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:02.905484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1212/2437] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:02 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:44:02.909835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335f6b-39e1-430a-8386-a6728918020c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:02.920395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335f6b-39e1-430a-8386-a6728918020c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:02.979553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefac83-20fd-4d0f-ad1a-953675c595a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:02.980175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefac83-20fd-4d0f-ad1a-953675c595a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:02.980454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefac83-20fd-4d0f-ad1a-953675c595a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:02.980725 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefac83-20fd-4d0f-ad1a-953675c595a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:02.981435 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefac83-20fd-4d0f-ad1a-953675c595a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:02.983933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefac83-20fd-4d0f-ad1a-953675c595a0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:02.991734 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:03.080559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1226/2438] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:02 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:03.084679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9903b3f-6fca-4573-a7dd-3fddfa4299b7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:03.095120 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9903b3f-6fca-4573-a7dd-3fddfa4299b7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:03.099794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e2e2-dac8-4d8f-9ffa-f375ef46d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:03.100407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e2e2-dac8-4d8f-9ffa-f375ef46d0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:03.100684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e2e2-dac8-4d8f-9ffa-f375ef46d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:03.100955 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e2e2-dac8-4d8f-9ffa-f375ef46d0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:03.101694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80e2e2-dac8-4d8f-9ffa-f375ef46d0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:03.103483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80e2e2-dac8-4d8f-9ffa-f375ef46d0ad admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:03.114891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1213/2439] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:03.118759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefac83-20fd-4d0f-ad1a-953675c595a0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:03.130084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefac83-20fd-4d0f-ad1a-953675c595a0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:03.135853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e3cc3-e164-4db6-a36a-057661d0889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:03.136720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e3cc3-e164-4db6-a36a-057661d0889b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:03.137126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e3cc3-e164-4db6-a36a-057661d0889b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:03.141579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e3cc3-e164-4db6-a36a-057661d0889b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:03.141579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e3cc3-e164-4db6-a36a-057661d0889b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:03.141579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e3cc3-e164-4db6-a36a-057661d0889b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:03.153353 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1227/2440] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:03.159819 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e2e2-dac8-4d8f-9ffa-f375ef46d0ad admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:03.174572 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e2e2-dac8-4d8f-9ffa-f375ef46d0ad admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:03.180769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73950356-eec7-40a1-91d1-3dbbc07e5b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:03.181898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73950356-eec7-40a1-91d1-3dbbc07e5b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:03.182311 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73950356-eec7-40a1-91d1-3dbbc07e5b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:03.182691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73950356-eec7-40a1-91d1-3dbbc07e5b33 admin admin] PATH_INFO: `/v3/projects/96e019640242438ca5ebb82487cf558d/users/630f6ae460614231ba5f2eb5839020d7/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:03.202949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73950356-eec7-40a1-91d1-3dbbc07e5b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e019640242438ca5ebb82487cf558d, user_id=630f6ae460614231ba5f2eb5839020d7, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:03.205873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73950356-eec7-40a1-91d1-3dbbc07e5b33 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:03.298371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1214/2441] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:03 2022] PUT /identity/v3/projects/96e019640242438ca5ebb82487cf558d/users/630f6ae460614231ba5f2eb5839020d7/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:03.309616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3025d-5510-4335-b3f0-72a8220f5103 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:03.313574 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3025d-5510-4335-b3f0-72a8220f5103 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:03.313574 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3025d-5510-4335-b3f0-72a8220f5103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:03.340712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bbf3025d-5510-4335-b3f0-72a8220f5103 None None] MFA Rules not processed for user `630f6ae460614231ba5f2eb5839020d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:03.342099 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bbf3025d-5510-4335-b3f0-72a8220f5103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:03.405790 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1228/2442] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:03.417355 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73950356-eec7-40a1-91d1-3dbbc07e5b33 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:03.419175 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-73950356-eec7-40a1-91d1-3dbbc07e5b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:03.429523 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:03.492561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73950356-eec7-40a1-91d1-3dbbc07e5b33 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:03.498248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02959056-9238-4550-9293-945bf741be0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:03.498865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02959056-9238-4550-9293-945bf741be0d service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:03.499146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02959056-9238-4550-9293-945bf741be0d service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:03.499417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02959056-9238-4550-9293-945bf741be0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:03.506978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02959056-9238-4550-9293-945bf741be0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:03.508549 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02959056-9238-4550-9293-945bf741be0d service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:03.517958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1215/2443] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:09.546512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3025d-5510-4335-b3f0-72a8220f5103 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:09.605393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3025d-5510-4335-b3f0-72a8220f5103 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:09.610527 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:09.611171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:09.611451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:09.611724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] PATH_INFO: `/v3/users/630f6ae460614231ba5f2eb5839020d7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:09.612887 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630f6ae460614231ba5f2eb5839020d7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:09.614856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:09.800970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630f6ae460614231ba5f2eb5839020d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:09.801623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630f6ae460614231ba5f2eb5839020d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:09.861496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630f6ae460614231ba5f2eb5839020d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:09.862378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630f6ae460614231ba5f2eb5839020d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:09.874957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:09.876656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630f6ae460614231ba5f2eb5839020d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:09.891994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1229/2444] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:09 2022] DELETE /identity/v3/users/630f6ae460614231ba5f2eb5839020d7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:09.893730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a7180-394a-43bd-a81c-9df5d53662cf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:09.894221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a7180-394a-43bd-a81c-9df5d53662cf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:09.894570 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a7180-394a-43bd-a81c-9df5d53662cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:09.915081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-170a7180-394a-43bd-a81c-9df5d53662cf None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:09.916302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-170a7180-394a-43bd-a81c-9df5d53662cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:09.978394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1216/2445] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:44:09.988935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:09.990495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:10.051330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058440c-3abd-4cd5-b6ac-f4fdef47a737 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:10.054963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22343659-0889-4a2e-a50b-0799417e2f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:10.055585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22343659-0889-4a2e-a50b-0799417e2f4c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:10.055868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22343659-0889-4a2e-a50b-0799417e2f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:10.056166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22343659-0889-4a2e-a50b-0799417e2f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:10.065720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22343659-0889-4a2e-a50b-0799417e2f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:10.067160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22343659-0889-4a2e-a50b-0799417e2f4c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:10.076946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1230/2446] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:10.554232 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a7180-394a-43bd-a81c-9df5d53662cf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:10.555726 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-170a7180-394a-43bd-a81c-9df5d53662cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:10.570365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a7180-394a-43bd-a81c-9df5d53662cf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:10.575118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:10.580107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:10.580107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:10.580107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] PATH_INFO: `/v3/projects/96e019640242438ca5ebb82487cf558d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:10.580107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e019640242438ca5ebb82487cf558d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:10.581104 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:10.668525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e019640242438ca5ebb82487cf558d', 'request_id': 'req-3d79b41f-59a8-49f6-854b-10c19086214f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:10.675248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e019640242438ca5ebb82487cf558d', 'request_id': 'req-3d79b41f-59a8-49f6-854b-10c19086214f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:10.680781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e019640242438ca5ebb82487cf558d', 'request_id': 'req-3d79b41f-59a8-49f6-854b-10c19086214f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:10.765659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] The token cache is being invalidate because project 96e019640242438ca5ebb82487cf558d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:10.765945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:10.766557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3d79b41f-59a8-49f6-854b-10c19086214f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:10.768053 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1217/2447] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:10 2022] DELETE /identity/v3/projects/96e019640242438ca5ebb82487cf558d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:10.772970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da601-a4f0-4a53-8ae6-0638b65b3447 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:10.773493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da601-a4f0-4a53-8ae6-0638b65b3447 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:10.773592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da601-a4f0-4a53-8ae6-0638b65b3447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:10.793497 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f80da601-a4f0-4a53-8ae6-0638b65b3447 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:10.794680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f80da601-a4f0-4a53-8ae6-0638b65b3447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:10.853230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1231/2448] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:10.861693 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdb505-5ac4-448c-8da8-00881fce9b43 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:10.861989 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdb505-5ac4-448c-8da8-00881fce9b43 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:10.862273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdb505-5ac4-448c-8da8-00881fce9b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:10.881949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-94bdb505-5ac4-448c-8da8-00881fce9b43 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:10.883159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-94bdb505-5ac4-448c-8da8-00881fce9b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:10.891276 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1218/2449] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:10.895355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80da601-a4f0-4a53-8ae6-0638b65b3447 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:10.906020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80da601-a4f0-4a53-8ae6-0638b65b3447 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:10.910932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a13868-9780-4dbb-a1ea-a7510e9eebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:10.911802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a13868-9780-4dbb-a1ea-a7510e9eebf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:10.912084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a13868-9780-4dbb-a1ea-a7510e9eebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:10.912360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a13868-9780-4dbb-a1ea-a7510e9eebf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:10.913162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a13868-9780-4dbb-a1ea-a7510e9eebf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:44:10.913472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a13868-9780-4dbb-a1ea-a7510e9eebf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:10.915066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a13868-9780-4dbb-a1ea-a7510e9eebf4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:10.927670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1232/2450] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:44:10.932004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdb505-5ac4-448c-8da8-00881fce9b43 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:10.941726 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdb505-5ac4-448c-8da8-00881fce9b43 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:10.946329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11643bd5-9956-441e-a39a-cfdbbfd933d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:10.946931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11643bd5-9956-441e-a39a-cfdbbfd933d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:10.947210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11643bd5-9956-441e-a39a-cfdbbfd933d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:10.947480 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11643bd5-9956-441e-a39a-cfdbbfd933d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:10.948176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11643bd5-9956-441e-a39a-cfdbbfd933d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:10.950235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11643bd5-9956-441e-a39a-cfdbbfd933d6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:10.955671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:11.045866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1219/2451] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:10 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:11.049939 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a13868-9780-4dbb-a1ea-a7510e9eebf4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:11.060055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a13868-9780-4dbb-a1ea-a7510e9eebf4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:11.117092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4732db-5ba6-4839-87b1-04e2b507960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:11.117750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4732db-5ba6-4839-87b1-04e2b507960c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:11.118030 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4732db-5ba6-4839-87b1-04e2b507960c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:11.118301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4732db-5ba6-4839-87b1-04e2b507960c admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:11.118974 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4732db-5ba6-4839-87b1-04e2b507960c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:11.120883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4732db-5ba6-4839-87b1-04e2b507960c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:11.204606 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1233/2452] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:11 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:11.208950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11643bd5-9956-441e-a39a-cfdbbfd933d6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:11.219981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11643bd5-9956-441e-a39a-cfdbbfd933d6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:11.225407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55818df-6052-4991-a17a-31a531af3aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:11.226023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55818df-6052-4991-a17a-31a531af3aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:11.226303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55818df-6052-4991-a17a-31a531af3aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:11.226578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55818df-6052-4991-a17a-31a531af3aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:11.227277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55818df-6052-4991-a17a-31a531af3aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:11.228915 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55818df-6052-4991-a17a-31a531af3aeb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:11.239204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1220/2453] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:11.243105 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4732db-5ba6-4839-87b1-04e2b507960c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:11.253193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4732db-5ba6-4839-87b1-04e2b507960c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:11.257995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22668d9a-c727-4214-8f3b-eee373390abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:11.258593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668d9a-c727-4214-8f3b-eee373390abc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:11.258872 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668d9a-c727-4214-8f3b-eee373390abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:11.259144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22668d9a-c727-4214-8f3b-eee373390abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:11.259829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22668d9a-c727-4214-8f3b-eee373390abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:11.261553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22668d9a-c727-4214-8f3b-eee373390abc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:11.262803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:11.273442 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1234/2454] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:11.277650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55818df-6052-4991-a17a-31a531af3aeb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:11.288378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55818df-6052-4991-a17a-31a531af3aeb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:11.292990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a45ad0-9e19-44f8-9948-9fc13fc17b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:11.293684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a45ad0-9e19-44f8-9948-9fc13fc17b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:11.293964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a45ad0-9e19-44f8-9948-9fc13fc17b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:11.294241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a45ad0-9e19-44f8-9948-9fc13fc17b93 admin admin] PATH_INFO: `/v3/projects/e11f75f948a04632b685b816c4d58c8f/users/df23c2041e6c4c95a7b050d74a440e36/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:11.309528 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a45ad0-9e19-44f8-9948-9fc13fc17b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11f75f948a04632b685b816c4d58c8f, user_id=df23c2041e6c4c95a7b050d74a440e36, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:11.313161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a45ad0-9e19-44f8-9948-9fc13fc17b93 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:11.389180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1221/2455] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:11 2022] PUT /identity/v3/projects/e11f75f948a04632b685b816c4d58c8f/users/df23c2041e6c4c95a7b050d74a440e36/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:11.415813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965332a-a5cc-41c1-92ac-2e8c208cebca None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:11.416100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965332a-a5cc-41c1-92ac-2e8c208cebca None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:11.416399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965332a-a5cc-41c1-92ac-2e8c208cebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:11.446328 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5965332a-a5cc-41c1-92ac-2e8c208cebca None None] MFA Rules not processed for user `df23c2041e6c4c95a7b050d74a440e36`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:11.447541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5965332a-a5cc-41c1-92ac-2e8c208cebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:11.515041 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1235/2456] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:11.519618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a45ad0-9e19-44f8-9948-9fc13fc17b93 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:11.586668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a45ad0-9e19-44f8-9948-9fc13fc17b93 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:11.591568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8552824-0e87-4a6b-9445-940c0cfa2077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:11.592701 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8552824-0e87-4a6b-9445-940c0cfa2077 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:11.592974 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8552824-0e87-4a6b-9445-940c0cfa2077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:11.593282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8552824-0e87-4a6b-9445-940c0cfa2077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:11.593944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8552824-0e87-4a6b-9445-940c0cfa2077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:11.595904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8552824-0e87-4a6b-9445-940c0cfa2077 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:11.715865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1222/2457] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:11 2022] POST /identity/v3/projects => generated 363 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:11.720394 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965332a-a5cc-41c1-92ac-2e8c208cebca None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:11.731192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965332a-a5cc-41c1-92ac-2e8c208cebca None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:11.788636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e188db9-e49d-4228-8572-28dd68b60fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:11.789346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e188db9-e49d-4228-8572-28dd68b60fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:11.789537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e188db9-e49d-4228-8572-28dd68b60fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:11.789812 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e188db9-e49d-4228-8572-28dd68b60fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:11.790465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e188db9-e49d-4228-8572-28dd68b60fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:11.792394 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e188db9-e49d-4228-8572-28dd68b60fa7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:11.897454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1236/2458] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:11 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:44:11.900334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8552824-0e87-4a6b-9445-940c0cfa2077 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:11.911213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8552824-0e87-4a6b-9445-940c0cfa2077 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:11.916038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0696fac-06ff-4a4b-a980-2f0d003d7a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:11.916641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0696fac-06ff-4a4b-a980-2f0d003d7a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:11.916923 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0696fac-06ff-4a4b-a980-2f0d003d7a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:11.917238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0696fac-06ff-4a4b-a980-2f0d003d7a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:11.917951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0696fac-06ff-4a4b-a980-2f0d003d7a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:11.919662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0696fac-06ff-4a4b-a980-2f0d003d7a3f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:11.930773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1223/2459] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:11.934706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e188db9-e49d-4228-8572-28dd68b60fa7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:11.945818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e188db9-e49d-4228-8572-28dd68b60fa7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:11.950522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a333a-7722-4b23-915f-c6daaa776a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:11.951332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a333a-7722-4b23-915f-c6daaa776a02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:11.951915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a333a-7722-4b23-915f-c6daaa776a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:11.952197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a333a-7722-4b23-915f-c6daaa776a02 admin admin] PATH_INFO: `/v3/projects/9a48bf9fdc8948bfae29ff21746eef04/users/179ff1568a91469991eb1ff8c182bf50/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:11.974245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a333a-7722-4b23-915f-c6daaa776a02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a48bf9fdc8948bfae29ff21746eef04, user_id=179ff1568a91469991eb1ff8c182bf50, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:11.974245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a333a-7722-4b23-915f-c6daaa776a02 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:12.044379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1237/2460] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:11 2022] PUT /identity/v3/projects/9a48bf9fdc8948bfae29ff21746eef04/users/179ff1568a91469991eb1ff8c182bf50/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:12.048800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0696fac-06ff-4a4b-a980-2f0d003d7a3f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:12.058914 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0696fac-06ff-4a4b-a980-2f0d003d7a3f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:12.119530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521840d-dd30-40dc-8910-8f3ae6dddaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:12.120149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521840d-dd30-40dc-8910-8f3ae6dddaed admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:12.120426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521840d-dd30-40dc-8910-8f3ae6dddaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:12.120694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521840d-dd30-40dc-8910-8f3ae6dddaed admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:12.121417 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521840d-dd30-40dc-8910-8f3ae6dddaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:12.123069 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521840d-dd30-40dc-8910-8f3ae6dddaed admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:12.134027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1224/2461] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:12.138325 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a333a-7722-4b23-915f-c6daaa776a02 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:12.149436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a333a-7722-4b23-915f-c6daaa776a02 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:12.154250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f205d-ac6c-47f6-935c-1a9166bb1ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:12.155930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f205d-ac6c-47f6-935c-1a9166bb1ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:12.156211 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f205d-ac6c-47f6-935c-1a9166bb1ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:12.156485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f205d-ac6c-47f6-935c-1a9166bb1ef6 admin admin] PATH_INFO: `/v3/projects/9a48bf9fdc8948bfae29ff21746eef04/users/179ff1568a91469991eb1ff8c182bf50/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:12.158565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f205d-ac6c-47f6-935c-1a9166bb1ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a48bf9fdc8948bfae29ff21746eef04, user_id=179ff1568a91469991eb1ff8c182bf50, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:12.161278 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f205d-ac6c-47f6-935c-1a9166bb1ef6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:12.172070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1238/2462] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:12 2022] PUT /identity/v3/projects/9a48bf9fdc8948bfae29ff21746eef04/users/179ff1568a91469991eb1ff8c182bf50/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:12.182470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19d61f-7349-409a-bcdb-f15bf6da9c34 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:12.182755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19d61f-7349-409a-bcdb-f15bf6da9c34 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:12.183024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19d61f-7349-409a-bcdb-f15bf6da9c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:12.212588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2f19d61f-7349-409a-bcdb-f15bf6da9c34 None None] MFA Rules not processed for user `179ff1568a91469991eb1ff8c182bf50`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:12.213869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2f19d61f-7349-409a-bcdb-f15bf6da9c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:12.224717 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:12.286603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1225/2463] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:12.298638 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f205d-ac6c-47f6-935c-1a9166bb1ef6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:12.300665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0c4f205d-ac6c-47f6-935c-1a9166bb1ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:12.346634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:12.361535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f205d-ac6c-47f6-935c-1a9166bb1ef6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:12.365219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ab795-d0df-4a79-b917-413e47b284e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:12.365829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab795-d0df-4a79-b917-413e47b284e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:12.367056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab795-d0df-4a79-b917-413e47b284e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:12.367337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab795-d0df-4a79-b917-413e47b284e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:12.377465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ab795-d0df-4a79-b917-413e47b284e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:12.380861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ab795-d0df-4a79-b917-413e47b284e0 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:12.389230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1239/2464] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:12.583093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19d61f-7349-409a-bcdb-f15bf6da9c34 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:12.592983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19d61f-7349-409a-bcdb-f15bf6da9c34 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:12.596702 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa63db0-4302-4912-b20c-da2b3a0ca93e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:12.597339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa63db0-4302-4912-b20c-da2b3a0ca93e service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:12.597658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa63db0-4302-4912-b20c-da2b3a0ca93e service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:12.597954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa63db0-4302-4912-b20c-da2b3a0ca93e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:12.656740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa63db0-4302-4912-b20c-da2b3a0ca93e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:12.658221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa63db0-4302-4912-b20c-da2b3a0ca93e service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:12.667832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1226/2465] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:16.080263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ab795-d0df-4a79-b917-413e47b284e0 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:16.081477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3c3ab795-d0df-4a79-b917-413e47b284e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:16.169768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ab795-d0df-4a79-b917-413e47b284e0 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:16.175529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a792a-be36-4000-8831-e7a82b0b2b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:16.180688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a792a-be36-4000-8831-e7a82b0b2b3a service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:16.180688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a792a-be36-4000-8831-e7a82b0b2b3a service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:16.180688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a792a-be36-4000-8831-e7a82b0b2b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:16.180688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7e8a792a-be36-4000-8831-e7a82b0b2b3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:16.192220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a792a-be36-4000-8831-e7a82b0b2b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:16.193921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a792a-be36-4000-8831-e7a82b0b2b3a service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:16.206053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1240/2466] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:21.447878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa63db0-4302-4912-b20c-da2b3a0ca93e service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:21.513353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa63db0-4302-4912-b20c-da2b3a0ca93e service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:21.517670 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:21.518384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:21.518728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:21.519066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] PATH_INFO: `/v3/users/df23c2041e6c4c95a7b050d74a440e36` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:21.522089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df23c2041e6c4c95a7b050d74a440e36)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:21.526556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a792a-be36-4000-8831-e7a82b0b2b3a service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:21.527975 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7e8a792a-be36-4000-8831-e7a82b0b2b3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:21.531027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:21.589959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a792a-be36-4000-8831-e7a82b0b2b3a service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:21.594261 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0d153-9e62-41da-9161-3213e5643755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:21.594878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0d153-9e62-41da-9161-3213e5643755 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:21.595156 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0d153-9e62-41da-9161-3213e5643755 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:21.595426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0d153-9e62-41da-9161-3213e5643755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:21.597224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3e0d153-9e62-41da-9161-3213e5643755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:21.609388 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0d153-9e62-41da-9161-3213e5643755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:21.610949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0d153-9e62-41da-9161-3213e5643755 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:21.620964 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1241/2467] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:44:21.681008 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df23c2041e6c4c95a7b050d74a440e36'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:21.682786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:21.754494 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df23c2041e6c4c95a7b050d74a440e36'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:21.755176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df23c2041e6c4c95a7b050d74a440e36'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:21.755787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df23c2041e6c4c95a7b050d74a440e36'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:21.770072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df23c2041e6c4c95a7b050d74a440e36'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:21.784137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1227/2468] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:21 2022] DELETE /identity/v3/users/df23c2041e6c4c95a7b050d74a440e36 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:21.789014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d250aa-7e41-4a34-9bfd-ebec21d8ce95 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:21.789327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d250aa-7e41-4a34-9bfd-ebec21d8ce95 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:21.792215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d250aa-7e41-4a34-9bfd-ebec21d8ce95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:21.809782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-17d250aa-7e41-4a34-9bfd-ebec21d8ce95 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:21.811696 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-17d250aa-7e41-4a34-9bfd-ebec21d8ce95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:21.877856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1242/2469] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:21.887818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:21.890279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:21.954307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867bb68-4b9b-4b06-b495-05e632b7ab89 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:21.958177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901539f-c53a-475d-822f-8ddaeae2f64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:21.958823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901539f-c53a-475d-822f-8ddaeae2f64f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:21.959107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901539f-c53a-475d-822f-8ddaeae2f64f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:21.959384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901539f-c53a-475d-822f-8ddaeae2f64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:21.969897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901539f-c53a-475d-822f-8ddaeae2f64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:21.971362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901539f-c53a-475d-822f-8ddaeae2f64f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:21.982154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1228/2470] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:22.423295 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d250aa-7e41-4a34-9bfd-ebec21d8ce95 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:22.425034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-17d250aa-7e41-4a34-9bfd-ebec21d8ce95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:22.439228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d250aa-7e41-4a34-9bfd-ebec21d8ce95 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:22.445242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:22.446264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:22.446694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:22.447228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] PATH_INFO: `/v3/projects/e11f75f948a04632b685b816c4d58c8f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:22.449471 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11f75f948a04632b685b816c4d58c8f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:22.452534 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:22.455587 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:22.558414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11f75f948a04632b685b816c4d58c8f', 'request_id': 'req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:22.564762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11f75f948a04632b685b816c4d58c8f', 'request_id': 'req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:22.570371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11f75f948a04632b685b816c4d58c8f', 'request_id': 'req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:22.649785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] The token cache is being invalidate because project e11f75f948a04632b685b816c4d58c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:22.650073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:22.650713 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:22.652222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1243/2471] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:22 2022] DELETE /identity/v3/projects/e11f75f948a04632b685b816c4d58c8f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:22.656932 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901539f-c53a-475d-822f-8ddaeae2f64f service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:22.666895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901539f-c53a-475d-822f-8ddaeae2f64f service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:22.723364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbb7cf-34dc-4eb7-b4b1-58aee3a62ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:22.723935 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbb7cf-34dc-4eb7-b4b1-58aee3a62ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:22.724217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbb7cf-34dc-4eb7-b4b1-58aee3a62ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:22.724487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbb7cf-34dc-4eb7-b4b1-58aee3a62ddc admin admin] PATH_INFO: `/v3/users/179ff1568a91469991eb1ff8c182bf50` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:22.725681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbb7cf-34dc-4eb7-b4b1-58aee3a62ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=179ff1568a91469991eb1ff8c182bf50)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:22.727654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbb7cf-34dc-4eb7-b4b1-58aee3a62ddc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:22.908852 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0bbb7cf-34dc-4eb7-b4b1-58aee3a62ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179ff1568a91469991eb1ff8c182bf50'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:22.981422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0bbb7cf-34dc-4eb7-b4b1-58aee3a62ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179ff1568a91469991eb1ff8c182bf50'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:22.982014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0bbb7cf-34dc-4eb7-b4b1-58aee3a62ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179ff1568a91469991eb1ff8c182bf50'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:22.982643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0bbb7cf-34dc-4eb7-b4b1-58aee3a62ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179ff1568a91469991eb1ff8c182bf50'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:22.997822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:23.000272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0bbb7cf-34dc-4eb7-b4b1-58aee3a62ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179ff1568a91469991eb1ff8c182bf50'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:23.012985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1229/2472] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:22 2022] DELETE /identity/v3/users/179ff1568a91469991eb1ff8c182bf50 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:23.435409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:23.437412 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:23.453399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3d0ba-7c11-4dcf-8c0a-6189933d4a37 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:23.519297 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:23.519949 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:23.520239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:23.520516 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] PATH_INFO: `/v3/projects/9a48bf9fdc8948bfae29ff21746eef04` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:23.521717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a48bf9fdc8948bfae29ff21746eef04)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:23.523653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:23.670737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a48bf9fdc8948bfae29ff21746eef04', 'request_id': 'req-d225ef78-beb2-4559-b533-99f81ec70516'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:23.677380 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a48bf9fdc8948bfae29ff21746eef04', 'request_id': 'req-d225ef78-beb2-4559-b533-99f81ec70516'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:23.683504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a48bf9fdc8948bfae29ff21746eef04', 'request_id': 'req-d225ef78-beb2-4559-b533-99f81ec70516'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:23.760175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] The token cache is being invalidate because project 9a48bf9fdc8948bfae29ff21746eef04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:23.760712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:23.761584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d225ef78-beb2-4559-b533-99f81ec70516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:23.763146 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1244/2473] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:23 2022] DELETE /identity/v3/projects/9a48bf9fdc8948bfae29ff21746eef04 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:23.770306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e31a54-cd56-4da9-8c02-f185afae6efa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:23.770306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e31a54-cd56-4da9-8c02-f185afae6efa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:23.770306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e31a54-cd56-4da9-8c02-f185afae6efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:23.793288 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b8e31a54-cd56-4da9-8c02-f185afae6efa None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:23.794616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b8e31a54-cd56-4da9-8c02-f185afae6efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:23.861437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1230/2474] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:23.870874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b3f27-cccb-48bb-b980-0db510a8603b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:23.871233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b3f27-cccb-48bb-b980-0db510a8603b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:23.871571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b3f27-cccb-48bb-b980-0db510a8603b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:23.895400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-074b3f27-cccb-48bb-b980-0db510a8603b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:23.896587 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-074b3f27-cccb-48bb-b980-0db510a8603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:23.905926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1245/2475] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:23.910416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e31a54-cd56-4da9-8c02-f185afae6efa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:23.921458 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e31a54-cd56-4da9-8c02-f185afae6efa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:23.926381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606a974-6e9f-4fa3-94ae-025092d6914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:23.927152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606a974-6e9f-4fa3-94ae-025092d6914e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:23.927393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606a974-6e9f-4fa3-94ae-025092d6914e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:23.927661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606a974-6e9f-4fa3-94ae-025092d6914e admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:23.928364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606a974-6e9f-4fa3-94ae-025092d6914e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:44:23.928661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606a974-6e9f-4fa3-94ae-025092d6914e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:23.931279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606a974-6e9f-4fa3-94ae-025092d6914e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:23.944936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1231/2476] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:44:23.949658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b3f27-cccb-48bb-b980-0db510a8603b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:23.969192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b3f27-cccb-48bb-b980-0db510a8603b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:23.974304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d313b-229f-4341-a5c0-b7aef3077978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:23.974929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d313b-229f-4341-a5c0-b7aef3077978 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:23.975212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d313b-229f-4341-a5c0-b7aef3077978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:23.975488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d313b-229f-4341-a5c0-b7aef3077978 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:23.976154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d313b-229f-4341-a5c0-b7aef3077978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:23.978108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d313b-229f-4341-a5c0-b7aef3077978 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:23.993389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:24.086501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1246/2477] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:23 2022] POST /identity/v3/projects => generated 409 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:24.087901 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606a974-6e9f-4fa3-94ae-025092d6914e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:24.098610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606a974-6e9f-4fa3-94ae-025092d6914e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:24.160699 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7b0f9-4b84-485b-a83e-50b51d51e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:24.161352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b0f9-4b84-485b-a83e-50b51d51e82a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:24.161896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b0f9-4b84-485b-a83e-50b51d51e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:24.162213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7b0f9-4b84-485b-a83e-50b51d51e82a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:24.163012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7b0f9-4b84-485b-a83e-50b51d51e82a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:24.165001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7b0f9-4b84-485b-a83e-50b51d51e82a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:24.244788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1232/2478] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:24 2022] POST /identity/v3/users => generated 305 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:24.249735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d313b-229f-4341-a5c0-b7aef3077978 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:24.260094 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d313b-229f-4341-a5c0-b7aef3077978 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:24.266090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d813ac8-3f7b-46a1-8140-fc08d6d99306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:24.266668 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d813ac8-3f7b-46a1-8140-fc08d6d99306 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:24.271778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d813ac8-3f7b-46a1-8140-fc08d6d99306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:24.271778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d813ac8-3f7b-46a1-8140-fc08d6d99306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:24.271778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d813ac8-3f7b-46a1-8140-fc08d6d99306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:24.271778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d813ac8-3f7b-46a1-8140-fc08d6d99306 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:24.280848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1247/2479] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:24.284623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7b0f9-4b84-485b-a83e-50b51d51e82a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:24.295626 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7b0f9-4b84-485b-a83e-50b51d51e82a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:24.299940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c315a2-f4cf-4aca-82a0-1471051e76d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:24.300563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c315a2-f4cf-4aca-82a0-1471051e76d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:24.300844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c315a2-f4cf-4aca-82a0-1471051e76d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:24.301115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c315a2-f4cf-4aca-82a0-1471051e76d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:24.301860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c315a2-f4cf-4aca-82a0-1471051e76d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:24.303473 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c315a2-f4cf-4aca-82a0-1471051e76d3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:24.315510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1233/2480] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:24.319875 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d813ac8-3f7b-46a1-8140-fc08d6d99306 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:24.331346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d813ac8-3f7b-46a1-8140-fc08d6d99306 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:24.336311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7c50a-0e24-4035-a555-01134daaf5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:24.336993 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c50a-0e24-4035-a555-01134daaf5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:24.337308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c50a-0e24-4035-a555-01134daaf5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:24.337728 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7c50a-0e24-4035-a555-01134daaf5bf admin admin] PATH_INFO: `/v3/projects/03cfd893c80b4a71bd21cdfdc45cad8b/users/76b15efbf6e0418aa875f92efcd142e6/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:24.358469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7c50a-0e24-4035-a555-01134daaf5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cfd893c80b4a71bd21cdfdc45cad8b, user_id=76b15efbf6e0418aa875f92efcd142e6, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:24.361177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7c50a-0e24-4035-a555-01134daaf5bf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:24.445227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1248/2481] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:24 2022] PUT /identity/v3/projects/03cfd893c80b4a71bd21cdfdc45cad8b/users/76b15efbf6e0418aa875f92efcd142e6/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:24.456922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caca962-8173-4c2e-940b-164a557681e9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:24.457325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caca962-8173-4c2e-940b-164a557681e9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:24.457680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caca962-8173-4c2e-940b-164a557681e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:24.486761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1caca962-8173-4c2e-940b-164a557681e9 None None] MFA Rules not processed for user `76b15efbf6e0418aa875f92efcd142e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:24.487970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1caca962-8173-4c2e-940b-164a557681e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:24.534447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:24.559066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1234/2482] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:24.563952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7c50a-0e24-4035-a555-01134daaf5bf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:24.637476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7c50a-0e24-4035-a555-01134daaf5bf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:24.642934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739cd73-e5c9-4e69-8abf-60dd1d85d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:24.643759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739cd73-e5c9-4e69-8abf-60dd1d85d94d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:24.644039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739cd73-e5c9-4e69-8abf-60dd1d85d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:24.644309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739cd73-e5c9-4e69-8abf-60dd1d85d94d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:24.644985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739cd73-e5c9-4e69-8abf-60dd1d85d94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:24.646918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739cd73-e5c9-4e69-8abf-60dd1d85d94d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:24.772673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1249/2483] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:24 2022] POST /identity/v3/projects => generated 407 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:44:24.775958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caca962-8173-4c2e-940b-164a557681e9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:24.788128 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caca962-8173-4c2e-940b-164a557681e9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:24.864395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9614e6-ccaa-49bb-9482-9db4a07356f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:24.864395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9614e6-ccaa-49bb-9482-9db4a07356f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:24.864395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9614e6-ccaa-49bb-9482-9db4a07356f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:24.864395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9614e6-ccaa-49bb-9482-9db4a07356f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:24.864826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9614e6-ccaa-49bb-9482-9db4a07356f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:24.864826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9614e6-ccaa-49bb-9482-9db4a07356f9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:24.959792 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1235/2484] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:24 2022] POST /identity/v3/users => generated 310 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:24.965252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739cd73-e5c9-4e69-8abf-60dd1d85d94d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:24.988070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739cd73-e5c9-4e69-8abf-60dd1d85d94d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:25.011970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e885a-a3ea-440e-bd1f-c28a8c0b34c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:25.013086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e885a-a3ea-440e-bd1f-c28a8c0b34c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:25.013603 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e885a-a3ea-440e-bd1f-c28a8c0b34c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:25.014892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e885a-a3ea-440e-bd1f-c28a8c0b34c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:25.016036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e885a-a3ea-440e-bd1f-c28a8c0b34c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:25.018715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e885a-a3ea-440e-bd1f-c28a8c0b34c4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:25.033189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1250/2485] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:25.037945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9614e6-ccaa-49bb-9482-9db4a07356f9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:25.057194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9614e6-ccaa-49bb-9482-9db4a07356f9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:25.063609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4d05-3d14-4ab2-ad72-d95ca07074d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:25.064301 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4d05-3d14-4ab2-ad72-d95ca07074d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:25.064580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4d05-3d14-4ab2-ad72-d95ca07074d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:25.064930 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4d05-3d14-4ab2-ad72-d95ca07074d6 admin admin] PATH_INFO: `/v3/projects/771c2ea9200d4d29bdaa50492c5d69db/users/9038ef948ab942eab20a3f669e740ae1/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:25.083748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4d05-3d14-4ab2-ad72-d95ca07074d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771c2ea9200d4d29bdaa50492c5d69db, user_id=9038ef948ab942eab20a3f669e740ae1, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:25.086461 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4d05-3d14-4ab2-ad72-d95ca07074d6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:25.181603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1236/2486] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:25 2022] PUT /identity/v3/projects/771c2ea9200d4d29bdaa50492c5d69db/users/9038ef948ab942eab20a3f669e740ae1/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:25.186166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e885a-a3ea-440e-bd1f-c28a8c0b34c4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:25.210972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e885a-a3ea-440e-bd1f-c28a8c0b34c4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:25.291620 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3f0d5-c05f-4660-8a7a-b054eff77546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:25.292313 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3f0d5-c05f-4660-8a7a-b054eff77546 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:25.292672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3f0d5-c05f-4660-8a7a-b054eff77546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:25.292957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3f0d5-c05f-4660-8a7a-b054eff77546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:25.293850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3f0d5-c05f-4660-8a7a-b054eff77546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:25.298340 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3f0d5-c05f-4660-8a7a-b054eff77546 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:25.309624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1251/2487] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:25.312639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4d05-3d14-4ab2-ad72-d95ca07074d6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:25.329945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4d05-3d14-4ab2-ad72-d95ca07074d6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:25.335537 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777a5ff-fe61-4dcf-bab7-678951b12ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:25.336233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777a5ff-fe61-4dcf-bab7-678951b12ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:25.336510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777a5ff-fe61-4dcf-bab7-678951b12ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:25.337037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777a5ff-fe61-4dcf-bab7-678951b12ac2 admin admin] PATH_INFO: `/v3/projects/771c2ea9200d4d29bdaa50492c5d69db/users/9038ef948ab942eab20a3f669e740ae1/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:25.343193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777a5ff-fe61-4dcf-bab7-678951b12ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771c2ea9200d4d29bdaa50492c5d69db, user_id=9038ef948ab942eab20a3f669e740ae1, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:25.346081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777a5ff-fe61-4dcf-bab7-678951b12ac2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:25.367681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1237/2488] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:25 2022] PUT /identity/v3/projects/771c2ea9200d4d29bdaa50492c5d69db/users/9038ef948ab942eab20a3f669e740ae1/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:25.372481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87230-d9d7-4e45-b723-bc451cf9ad80 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:25.373042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87230-d9d7-4e45-b723-bc451cf9ad80 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:25.374170 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87230-d9d7-4e45-b723-bc451cf9ad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:25.415764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-45a87230-d9d7-4e45-b723-bc451cf9ad80 None None] MFA Rules not processed for user `9038ef948ab942eab20a3f669e740ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:25.419822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45a87230-d9d7-4e45-b723-bc451cf9ad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:25.434641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:25.488936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1252/2489] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:25 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:44:25.500544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777a5ff-fe61-4dcf-bab7-678951b12ac2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:25.502412 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e777a5ff-fe61-4dcf-bab7-678951b12ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:25.591428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777a5ff-fe61-4dcf-bab7-678951b12ac2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:25.596688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe4331-d876-47a1-82ac-5658e708d241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:25.597505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4331-d876-47a1-82ac-5658e708d241 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:25.598038 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4331-d876-47a1-82ac-5658e708d241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:25.598430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4331-d876-47a1-82ac-5658e708d241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:25.609818 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe4331-d876-47a1-82ac-5658e708d241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:25.611445 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe4331-d876-47a1-82ac-5658e708d241 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:25.623204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1238/2490] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:25 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:26.006067 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a87230-d9d7-4e45-b723-bc451cf9ad80 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:26.016504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a87230-d9d7-4e45-b723-bc451cf9ad80 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:26.022041 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdaa6a1-1bc4-4627-9f11-2a3e3bb6d7a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:26.022709 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaa6a1-1bc4-4627-9f11-2a3e3bb6d7a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:26.022955 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaa6a1-1bc4-4627-9f11-2a3e3bb6d7a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:26.023228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaa6a1-1bc4-4627-9f11-2a3e3bb6d7a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:26.087198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdaa6a1-1bc4-4627-9f11-2a3e3bb6d7a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:26.088652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdaa6a1-1bc4-4627-9f11-2a3e3bb6d7a5 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:26.098099 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1253/2491] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:29.708450 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe4331-d876-47a1-82ac-5658e708d241 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:29.710891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-36fe4331-d876-47a1-82ac-5658e708d241 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:29.766525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:29.791908 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe4331-d876-47a1-82ac-5658e708d241 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:29.797923 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:29.798609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:29.798891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:29.799377 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] PATH_INFO: `/v3/users/5290a9196a8a48c5bfbefc108c58fffb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:29.800634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5290a9196a8a48c5bfbefc108c58fffb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:29.802609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:29.998535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5290a9196a8a48c5bfbefc108c58fffb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:30.091882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5290a9196a8a48c5bfbefc108c58fffb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:30.093207 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5290a9196a8a48c5bfbefc108c58fffb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:30.093864 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5290a9196a8a48c5bfbefc108c58fffb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:30.106961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5290a9196a8a48c5bfbefc108c58fffb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:30.124164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1239/2492] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:29 2022] DELETE /identity/v3/users/5290a9196a8a48c5bfbefc108c58fffb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:30.424976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdaa6a1-1bc4-4627-9f11-2a3e3bb6d7a5 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:30.437240 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdaa6a1-1bc4-4627-9f11-2a3e3bb6d7a5 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:30.497375 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:30.498627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:30.498924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:30.499198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] PATH_INFO: `/v3/projects/94cab9a807b6465e842b7fef844b2a50` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:30.500432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=94cab9a807b6465e842b7fef844b2a50)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:30.502371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:30.617036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94cab9a807b6465e842b7fef844b2a50', 'request_id': 'req-70d5b422-22c8-4a6a-a99f-37b16d633dbf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:30.624073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94cab9a807b6465e842b7fef844b2a50', 'request_id': 'req-70d5b422-22c8-4a6a-a99f-37b16d633dbf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:30.625355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:30.630250 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94cab9a807b6465e842b7fef844b2a50', 'request_id': 'req-70d5b422-22c8-4a6a-a99f-37b16d633dbf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:30.712564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] The token cache is being invalidate because project 94cab9a807b6465e842b7fef844b2a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:30.712791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:30.713474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:30.715046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1254/2493] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:30 2022] DELETE /identity/v3/projects/94cab9a807b6465e842b7fef844b2a50 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:30.719576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:30.720972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:30.735113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ba30c-8e31-48f7-a40d-8c88ea293f77 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:30.791680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:30.792334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:30.792609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:30.792881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] PATH_INFO: `/v3/users/d8ef13733c224600820ff27f4aac4696` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:30.794068 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ef13733c224600820ff27f4aac4696)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:30.796791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:31.031327 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ef13733c224600820ff27f4aac4696'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:31.141635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ef13733c224600820ff27f4aac4696'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:31.142412 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ef13733c224600820ff27f4aac4696'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:31.143040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ef13733c224600820ff27f4aac4696'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:31.149296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:31.157689 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ef13733c224600820ff27f4aac4696'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:31.175977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1240/2494] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:30 2022] DELETE /identity/v3/users/d8ef13733c224600820ff27f4aac4696 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:31.425238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:31.426760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:31.439850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5b422-22c8-4a6a-a99f-37b16d633dbf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:31.497685 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:31.498360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:31.498644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:31.498923 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] PATH_INFO: `/v3/projects/4fdea2c410104d10ae8226ec272526e4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:31.500089 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fdea2c410104d10ae8226ec272526e4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:31.502077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:31.662451 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fdea2c410104d10ae8226ec272526e4', 'request_id': 'req-60b77484-ecf4-42f4-9b17-2a45d7d95935'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:31.669028 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fdea2c410104d10ae8226ec272526e4', 'request_id': 'req-60b77484-ecf4-42f4-9b17-2a45d7d95935'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:31.676697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fdea2c410104d10ae8226ec272526e4', 'request_id': 'req-60b77484-ecf4-42f4-9b17-2a45d7d95935'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:31.754886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] The token cache is being invalidate because project 4fdea2c410104d10ae8226ec272526e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:31.755173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:31.755815 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:31.757370 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1255/2495] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:31 2022] DELETE /identity/v3/projects/4fdea2c410104d10ae8226ec272526e4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:33.026438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:33.027931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:33.086808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a18f1a-ba2f-4c8e-bf2f-e047f3765d76 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:33.138464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f417a4b-8b16-4227-a01b-8fa702accec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:33.139752 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f417a4b-8b16-4227-a01b-8fa702accec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:33.140125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f417a4b-8b16-4227-a01b-8fa702accec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:33.140285 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f417a4b-8b16-4227-a01b-8fa702accec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:33.146463 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6f417a4b-8b16-4227-a01b-8fa702accec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:33.147615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:33.149069 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:33.214967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f417a4b-8b16-4227-a01b-8fa702accec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:33.216339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f417a4b-8b16-4227-a01b-8fa702accec8 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:33.217939 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b77484-ecf4-42f4-9b17-2a45d7d95935 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:33.222599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:33.223236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:33.223515 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:33.223794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] PATH_INFO: `/v3/users/76b15efbf6e0418aa875f92efcd142e6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:33.224960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b15efbf6e0418aa875f92efcd142e6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:33.226368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1241/2496] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:33.227026 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:33.242853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:33.414957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b15efbf6e0418aa875f92efcd142e6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:33.415607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b15efbf6e0418aa875f92efcd142e6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:33.503725 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b15efbf6e0418aa875f92efcd142e6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:33.504426 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b15efbf6e0418aa875f92efcd142e6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:33.517600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b15efbf6e0418aa875f92efcd142e6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:33.531051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1256/2497] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:33 2022] DELETE /identity/v3/users/76b15efbf6e0418aa875f92efcd142e6 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:33.535832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c6ba7-5ad0-4baf-a62e-6dc8dd7741eb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:33.536160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c6ba7-5ad0-4baf-a62e-6dc8dd7741eb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:33.536440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c6ba7-5ad0-4baf-a62e-6dc8dd7741eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:33.555744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6e3c6ba7-5ad0-4baf-a62e-6dc8dd7741eb None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:33.556939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e3c6ba7-5ad0-4baf-a62e-6dc8dd7741eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:33.596229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:33.616773 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1242/2498] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:33.626749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:33.628178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:33.687318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037b1eb-678f-410a-a579-d691b6989bb2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:33.691038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8d2d4-4a9e-4c9e-a85a-9dc54d2eb4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:33.691687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d2d4-4a9e-4c9e-a85a-9dc54d2eb4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:33.692106 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d2d4-4a9e-4c9e-a85a-9dc54d2eb4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:33.692403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d2d4-4a9e-4c9e-a85a-9dc54d2eb4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:33.702156 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8d2d4-4a9e-4c9e-a85a-9dc54d2eb4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:33.703790 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8d2d4-4a9e-4c9e-a85a-9dc54d2eb4c5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:33.713849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1257/2499] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:34.149015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c6ba7-5ad0-4baf-a62e-6dc8dd7741eb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:34.149015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e3c6ba7-5ad0-4baf-a62e-6dc8dd7741eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:34.174419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c6ba7-5ad0-4baf-a62e-6dc8dd7741eb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:34.179484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:34.180257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:34.180642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:34.181014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] PATH_INFO: `/v3/projects/03cfd893c80b4a71bd21cdfdc45cad8b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:34.182473 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cfd893c80b4a71bd21cdfdc45cad8b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:34.184748 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:34.304257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cfd893c80b4a71bd21cdfdc45cad8b', 'request_id': 'req-9189153c-2caf-4208-b781-f728aaa827f9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:34.311735 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cfd893c80b4a71bd21cdfdc45cad8b', 'request_id': 'req-9189153c-2caf-4208-b781-f728aaa827f9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:34.318402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cfd893c80b4a71bd21cdfdc45cad8b', 'request_id': 'req-9189153c-2caf-4208-b781-f728aaa827f9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:34.398318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] The token cache is being invalidate because project 03cfd893c80b4a71bd21cdfdc45cad8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:34.398672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:34.399376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:34.400934 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1243/2500] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:34 2022] DELETE /identity/v3/projects/03cfd893c80b4a71bd21cdfdc45cad8b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:34.404951 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8d2d4-4a9e-4c9e-a85a-9dc54d2eb4c5 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:34.415299 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8d2d4-4a9e-4c9e-a85a-9dc54d2eb4c5 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:34.475473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80604edb-2792-4a20-a783-6778b62bf11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:34.476072 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604edb-2792-4a20-a783-6778b62bf11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:34.476348 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604edb-2792-4a20-a783-6778b62bf11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:34.476622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604edb-2792-4a20-a783-6778b62bf11c admin admin] PATH_INFO: `/v3/users/9038ef948ab942eab20a3f669e740ae1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:34.477940 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80604edb-2792-4a20-a783-6778b62bf11c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9038ef948ab942eab20a3f669e740ae1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:34.479878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80604edb-2792-4a20-a783-6778b62bf11c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:34.646269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:34.655460 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-80604edb-2792-4a20-a783-6778b62bf11c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9038ef948ab942eab20a3f669e740ae1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:34.656372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-80604edb-2792-4a20-a783-6778b62bf11c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9038ef948ab942eab20a3f669e740ae1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:34.720252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-80604edb-2792-4a20-a783-6778b62bf11c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9038ef948ab942eab20a3f669e740ae1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:34.720908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-80604edb-2792-4a20-a783-6778b62bf11c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9038ef948ab942eab20a3f669e740ae1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:34.734559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-80604edb-2792-4a20-a783-6778b62bf11c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9038ef948ab942eab20a3f669e740ae1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:34.748132 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1258/2501] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:34 2022] DELETE /identity/v3/users/9038ef948ab942eab20a3f669e740ae1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:35.248902 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:35.250453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:35.272641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189153c-2caf-4208-b781-f728aaa827f9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:35.337829 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:35.338486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:35.338769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:35.339047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] PATH_INFO: `/v3/projects/771c2ea9200d4d29bdaa50492c5d69db` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:35.340236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=771c2ea9200d4d29bdaa50492c5d69db)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:35.342453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:35.465365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771c2ea9200d4d29bdaa50492c5d69db', 'request_id': 'req-a4c5ba2b-1b10-4abb-b816-2104dba61ada'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:35.471568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771c2ea9200d4d29bdaa50492c5d69db', 'request_id': 'req-a4c5ba2b-1b10-4abb-b816-2104dba61ada'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:35.477251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771c2ea9200d4d29bdaa50492c5d69db', 'request_id': 'req-a4c5ba2b-1b10-4abb-b816-2104dba61ada'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:35.480795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:35.546470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] The token cache is being invalidate because project 771c2ea9200d4d29bdaa50492c5d69db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:35.546790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:35.547384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a4c5ba2b-1b10-4abb-b816-2104dba61ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:35.548894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1244/2502] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:35 2022] DELETE /identity/v3/projects/771c2ea9200d4d29bdaa50492c5d69db => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:35.553754 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f73d1-ca69-4f18-9ad5-0ab25343473d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:35.554212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f73d1-ca69-4f18-9ad5-0ab25343473d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:35.554363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f73d1-ca69-4f18-9ad5-0ab25343473d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:35.575182 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-422f73d1-ca69-4f18-9ad5-0ab25343473d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:35.576954 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-422f73d1-ca69-4f18-9ad5-0ab25343473d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:35.641936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1259/2503] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:44:35.649783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788dbb7-2d15-4597-8b45-66e230f6f1c1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:35.650026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788dbb7-2d15-4597-8b45-66e230f6f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:35.650305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788dbb7-2d15-4597-8b45-66e230f6f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:35.671026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4788dbb7-2d15-4597-8b45-66e230f6f1c1 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:35.672248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4788dbb7-2d15-4597-8b45-66e230f6f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:35.680890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1245/2504] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:35.684881 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f73d1-ca69-4f18-9ad5-0ab25343473d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:35.695224 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f73d1-ca69-4f18-9ad5-0ab25343473d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:35.699759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ccfcc-4965-48ed-a1c9-e9021c49dbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:35.700367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ccfcc-4965-48ed-a1c9-e9021c49dbca admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:35.700646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ccfcc-4965-48ed-a1c9-e9021c49dbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:35.700918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ccfcc-4965-48ed-a1c9-e9021c49dbca admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:35.702270 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ccfcc-4965-48ed-a1c9-e9021c49dbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:44:35.702573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ccfcc-4965-48ed-a1c9-e9021c49dbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:35.704165 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ccfcc-4965-48ed-a1c9-e9021c49dbca admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:35.719294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1260/2505] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:44:35.720641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788dbb7-2d15-4597-8b45-66e230f6f1c1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:35.741442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788dbb7-2d15-4597-8b45-66e230f6f1c1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:35.746435 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9ec19-c21b-46b7-9044-b48fab5065ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:35.747095 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9ec19-c21b-46b7-9044-b48fab5065ee admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:35.747578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9ec19-c21b-46b7-9044-b48fab5065ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:35.747714 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9ec19-c21b-46b7-9044-b48fab5065ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:35.748841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9ec19-c21b-46b7-9044-b48fab5065ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:35.750851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9ec19-c21b-46b7-9044-b48fab5065ee admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:35.882247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1246/2506] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:35 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:35.886304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ccfcc-4965-48ed-a1c9-e9021c49dbca admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:35.896722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ccfcc-4965-48ed-a1c9-e9021c49dbca admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:35.953685 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b313a9-1ce6-450e-b493-cb975aaa7cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:35.954309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b313a9-1ce6-450e-b493-cb975aaa7cac admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:35.954583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b313a9-1ce6-450e-b493-cb975aaa7cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:35.954851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b313a9-1ce6-450e-b493-cb975aaa7cac admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:35.955520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b313a9-1ce6-450e-b493-cb975aaa7cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:35.957458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b313a9-1ce6-450e-b493-cb975aaa7cac admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:36.050638 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1261/2507] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:35 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:44:36.051779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9ec19-c21b-46b7-9044-b48fab5065ee admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:36.063539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9ec19-c21b-46b7-9044-b48fab5065ee admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:36.068639 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f72c09-82d0-4a97-a698-250b68f96cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:36.069298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72c09-82d0-4a97-a698-250b68f96cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:36.069584 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72c09-82d0-4a97-a698-250b68f96cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:36.069899 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72c09-82d0-4a97-a698-250b68f96cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:36.070775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f72c09-82d0-4a97-a698-250b68f96cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:36.072403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f72c09-82d0-4a97-a698-250b68f96cb9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:36.083873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1247/2508] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:36.087636 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b313a9-1ce6-450e-b493-cb975aaa7cac admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:36.098459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b313a9-1ce6-450e-b493-cb975aaa7cac admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:36.103262 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323b735-0bb2-4c2c-9640-eb9a19914196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:36.103875 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323b735-0bb2-4c2c-9640-eb9a19914196 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:36.104309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323b735-0bb2-4c2c-9640-eb9a19914196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:36.104710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323b735-0bb2-4c2c-9640-eb9a19914196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:36.105448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323b735-0bb2-4c2c-9640-eb9a19914196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:36.107055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323b735-0bb2-4c2c-9640-eb9a19914196 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:36.118920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1262/2509] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:36.123060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f72c09-82d0-4a97-a698-250b68f96cb9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:36.133619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f72c09-82d0-4a97-a698-250b68f96cb9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:36.138400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836083-add6-4379-b028-98c7353d7be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:36.139359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836083-add6-4379-b028-98c7353d7be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:36.139359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836083-add6-4379-b028-98c7353d7be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:36.139722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836083-add6-4379-b028-98c7353d7be0 admin admin] PATH_INFO: `/v3/projects/3151e60599ab47ab938786d9f899d03a/users/b0730c925c824388a2aa61abb5379cfd/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:36.162669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836083-add6-4379-b028-98c7353d7be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3151e60599ab47ab938786d9f899d03a, user_id=b0730c925c824388a2aa61abb5379cfd, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:36.165415 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836083-add6-4379-b028-98c7353d7be0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:36.256448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1248/2510] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:36 2022] PUT /identity/v3/projects/3151e60599ab47ab938786d9f899d03a/users/b0730c925c824388a2aa61abb5379cfd/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:36.267654 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b0a22-5269-4967-a579-2ec648c9fa88 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:36.267944 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b0a22-5269-4967-a579-2ec648c9fa88 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:36.268220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b0a22-5269-4967-a579-2ec648c9fa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:36.305873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b45b0a22-5269-4967-a579-2ec648c9fa88 None None] MFA Rules not processed for user `b0730c925c824388a2aa61abb5379cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:36.307037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b45b0a22-5269-4967-a579-2ec648c9fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:36.316827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:36.395718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1263/2511] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:36.399867 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836083-add6-4379-b028-98c7353d7be0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:36.498962 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836083-add6-4379-b028-98c7353d7be0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:36.504945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c141b-643e-4a48-b13f-990c07716211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:36.505875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c141b-643e-4a48-b13f-990c07716211 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:36.505875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c141b-643e-4a48-b13f-990c07716211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:36.506293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c141b-643e-4a48-b13f-990c07716211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:36.506983 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c141b-643e-4a48-b13f-990c07716211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:36.508963 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c141b-643e-4a48-b13f-990c07716211 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:36.603761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1249/2512] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:36 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:36.604897 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b0a22-5269-4967-a579-2ec648c9fa88 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:36.618417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b0a22-5269-4967-a579-2ec648c9fa88 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:36.676279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfb544-44d0-4f1b-bb8f-5032e3cc3ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:36.676911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfb544-44d0-4f1b-bb8f-5032e3cc3ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:36.683548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfb544-44d0-4f1b-bb8f-5032e3cc3ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:36.683548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfb544-44d0-4f1b-bb8f-5032e3cc3ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:36.683548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfb544-44d0-4f1b-bb8f-5032e3cc3ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:36.683548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfb544-44d0-4f1b-bb8f-5032e3cc3ca0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:36.777710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1264/2513] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:36 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:44:36.782504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c141b-643e-4a48-b13f-990c07716211 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:36.793210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c141b-643e-4a48-b13f-990c07716211 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:36.798156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82580be-d010-44f1-b01f-537484a4018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:36.798779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82580be-d010-44f1-b01f-537484a4018a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:36.799059 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82580be-d010-44f1-b01f-537484a4018a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:36.799326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82580be-d010-44f1-b01f-537484a4018a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:36.800024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82580be-d010-44f1-b01f-537484a4018a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:36.801707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82580be-d010-44f1-b01f-537484a4018a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:36.813121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1250/2514] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:36.817565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfb544-44d0-4f1b-bb8f-5032e3cc3ca0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:36.829058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfb544-44d0-4f1b-bb8f-5032e3cc3ca0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:36.834306 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b6585-9d58-4ff4-84a3-8247c9410b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:36.835627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b6585-9d58-4ff4-84a3-8247c9410b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:36.835919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b6585-9d58-4ff4-84a3-8247c9410b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:36.836230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b6585-9d58-4ff4-84a3-8247c9410b66 admin admin] PATH_INFO: `/v3/projects/07c11ece77c4410ea3c8c6b3e3a36fb4/users/6f8f6180e3e9485e99ddc29e7b6e3aa0/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:36.853363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b6585-9d58-4ff4-84a3-8247c9410b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c11ece77c4410ea3c8c6b3e3a36fb4, user_id=6f8f6180e3e9485e99ddc29e7b6e3aa0, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:36.856042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b6585-9d58-4ff4-84a3-8247c9410b66 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:36.879079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82580be-d010-44f1-b01f-537484a4018a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:36.880871 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d82580be-d010-44f1-b01f-537484a4018a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:36.953848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82580be-d010-44f1-b01f-537484a4018a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:36.959456 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:36.960408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1265/2515] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:36 2022] PUT /identity/v3/projects/07c11ece77c4410ea3c8c6b3e3a36fb4/users/6f8f6180e3e9485e99ddc29e7b6e3aa0/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:36.964526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b6585-9d58-4ff4-84a3-8247c9410b66 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:37.023923 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad9176-9a29-4dbf-adc9-513ebf6a2b39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5593bc41bce41b4b44616c355976cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:37.024558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad9176-9a29-4dbf-adc9-513ebf6a2b39 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:37.024845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad9176-9a29-4dbf-adc9-513ebf6a2b39 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:37.025115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad9176-9a29-4dbf-adc9-513ebf6a2b39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:37.026973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-46ad9176-9a29-4dbf-adc9-513ebf6a2b39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:37.048682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b6585-9d58-4ff4-84a3-8247c9410b66 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:37.048859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad9176-9a29-4dbf-adc9-513ebf6a2b39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:37.048859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad9176-9a29-4dbf-adc9-513ebf6a2b39 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:37.049079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f1035-b847-4b09-a2a1-ba858c18f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:37.049079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f1035-b847-4b09-a2a1-ba858c18f133 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:37.049079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f1035-b847-4b09-a2a1-ba858c18f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:37.049079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f1035-b847-4b09-a2a1-ba858c18f133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:37.049485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f1035-b847-4b09-a2a1-ba858c18f133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:37.049485 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f1035-b847-4b09-a2a1-ba858c18f133 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:37.050160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1251/2516] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:44:37.050967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad9176-9a29-4dbf-adc9-513ebf6a2b39 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:37.052326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-46ad9176-9a29-4dbf-adc9-513ebf6a2b39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:37.058414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1266/2517] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:44:37.061310 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f1035-b847-4b09-a2a1-ba858c18f133 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:37.066535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad9176-9a29-4dbf-adc9-513ebf6a2b39 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:37.072025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f1035-b847-4b09-a2a1-ba858c18f133 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:37.074070 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:37.074904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:37.075341 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:37.075799 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] PATH_INFO: `/v3/users/9b14f38f371b405f915a7a9ba8c61569` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:37.076916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d4a89-ffe1-41cc-b4f8-011f96e40ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:37.077411 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b14f38f371b405f915a7a9ba8c61569)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:37.077618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d4a89-ffe1-41cc-b4f8-011f96e40ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:37.078097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d4a89-ffe1-41cc-b4f8-011f96e40ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:37.078395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d4a89-ffe1-41cc-b4f8-011f96e40ccd admin admin] PATH_INFO: `/v3/projects/07c11ece77c4410ea3c8c6b3e3a36fb4/users/6f8f6180e3e9485e99ddc29e7b6e3aa0/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:37.080594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d4a89-ffe1-41cc-b4f8-011f96e40ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c11ece77c4410ea3c8c6b3e3a36fb4, user_id=6f8f6180e3e9485e99ddc29e7b6e3aa0, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:37.081286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:37.083291 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d4a89-ffe1-41cc-b4f8-011f96e40ccd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:37.089880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:37.096013 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1267/2518] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:37 2022] PUT /identity/v3/projects/07c11ece77c4410ea3c8c6b3e3a36fb4/users/6f8f6180e3e9485e99ddc29e7b6e3aa0/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:37.108640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffec47a-f0ca-483f-98f9-5040a694b846 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:37.108922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffec47a-f0ca-483f-98f9-5040a694b846 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:37.109242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffec47a-f0ca-483f-98f9-5040a694b846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:37.141186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2ffec47a-f0ca-483f-98f9-5040a694b846 None None] MFA Rules not processed for user `6f8f6180e3e9485e99ddc29e7b6e3aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:37.141186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ffec47a-f0ca-483f-98f9-5040a694b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:37.216137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1268/2519] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:44:37.227583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffec47a-f0ca-483f-98f9-5040a694b846 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:37.228959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ffec47a-f0ca-483f-98f9-5040a694b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:37.266905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b14f38f371b405f915a7a9ba8c61569'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:37.293053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffec47a-f0ca-483f-98f9-5040a694b846 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:37.297408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c77048-82d7-4452-a0a8-614d8b191442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:37.298024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c77048-82d7-4452-a0a8-614d8b191442 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:37.298309 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c77048-82d7-4452-a0a8-614d8b191442 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:37.298584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c77048-82d7-4452-a0a8-614d8b191442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:37.308792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c77048-82d7-4452-a0a8-614d8b191442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:37.309103 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c77048-82d7-4452-a0a8-614d8b191442 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:37.319583 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1269/2520] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:44:37.320330 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b14f38f371b405f915a7a9ba8c61569'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:37.321100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b14f38f371b405f915a7a9ba8c61569'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:37.321792 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b14f38f371b405f915a7a9ba8c61569'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:37.335113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b14f38f371b405f915a7a9ba8c61569'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:37.348151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1252/2521] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:37 2022] DELETE /identity/v3/users/9b14f38f371b405f915a7a9ba8c61569 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:37.512774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c77048-82d7-4452-a0a8-614d8b191442 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:37.521489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c77048-82d7-4452-a0a8-614d8b191442 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:37.571301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f0b39-3134-46a0-a375-9ec56d35f1da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:37.571849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f0b39-3134-46a0-a375-9ec56d35f1da service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:37.572131 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f0b39-3134-46a0-a375-9ec56d35f1da service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:37.572404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f0b39-3134-46a0-a375-9ec56d35f1da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:37.574188 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dd4f0b39-3134-46a0-a375-9ec56d35f1da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:37.606088 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:37.608030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:37.625498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:37.644278 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f0b39-3134-46a0-a375-9ec56d35f1da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:37.645885 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f0b39-3134-46a0-a375-9ec56d35f1da service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:37.656634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1270/2522] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:37.680019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e0b02-17f0-408d-a573-dbf2a5aad43f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:37.692132 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:37.692931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:37.693378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:37.693713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] PATH_INFO: `/v3/projects/1a87ef43f3fa49898368e4fd749bda21` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:37.695032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a87ef43f3fa49898368e4fd749bda21)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:37.696970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:37.708922 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:37.815089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a87ef43f3fa49898368e4fd749bda21', 'request_id': 'req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:37.821102 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a87ef43f3fa49898368e4fd749bda21', 'request_id': 'req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:37.827314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a87ef43f3fa49898368e4fd749bda21', 'request_id': 'req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:37.897035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] The token cache is being invalidate because project 1a87ef43f3fa49898368e4fd749bda21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:37.897346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:37.897973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e30a01ee-5fcc-4a1b-ba65-39d5837d2d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:37.899506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1253/2523] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:37 2022] DELETE /identity/v3/projects/1a87ef43f3fa49898368e4fd749bda21 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:37.905200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959db21a-81d2-4b8f-9761-bfcb4ee0f25e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:37.905490 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959db21a-81d2-4b8f-9761-bfcb4ee0f25e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:37.905764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959db21a-81d2-4b8f-9761-bfcb4ee0f25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:37.926436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-959db21a-81d2-4b8f-9761-bfcb4ee0f25e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:37.927642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-959db21a-81d2-4b8f-9761-bfcb4ee0f25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:37.989027 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1271/2524] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:44:37.997736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405bb0-e032-4ca1-9700-f6e097dfdbd8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:37.998022 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405bb0-e032-4ca1-9700-f6e097dfdbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:37.998335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405bb0-e032-4ca1-9700-f6e097dfdbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:38.018575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d8405bb0-e032-4ca1-9700-f6e097dfdbd8 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:38.019783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d8405bb0-e032-4ca1-9700-f6e097dfdbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:38.027807 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1254/2525] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:38.032843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959db21a-81d2-4b8f-9761-bfcb4ee0f25e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:38.042723 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959db21a-81d2-4b8f-9761-bfcb4ee0f25e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:38.047477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310166c-5ada-4336-93ba-3b85a0015d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:38.048090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310166c-5ada-4336-93ba-3b85a0015d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:38.048368 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310166c-5ada-4336-93ba-3b85a0015d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:38.048647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310166c-5ada-4336-93ba-3b85a0015d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:38.049375 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310166c-5ada-4336-93ba-3b85a0015d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:44:38.049684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310166c-5ada-4336-93ba-3b85a0015d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:38.051364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310166c-5ada-4336-93ba-3b85a0015d12 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:38.063492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1272/2526] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:44:38.067851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8405bb0-e032-4ca1-9700-f6e097dfdbd8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:38.082926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8405bb0-e032-4ca1-9700-f6e097dfdbd8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:38.082926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077da73-b11d-4eee-91d9-4dd95ef388d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:38.082926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077da73-b11d-4eee-91d9-4dd95ef388d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:38.083249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077da73-b11d-4eee-91d9-4dd95ef388d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:38.083403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077da73-b11d-4eee-91d9-4dd95ef388d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:38.084074 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077da73-b11d-4eee-91d9-4dd95ef388d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:38.086031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077da73-b11d-4eee-91d9-4dd95ef388d7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:38.166565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1255/2527] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:38 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:38.170953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310166c-5ada-4336-93ba-3b85a0015d12 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:38.181034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310166c-5ada-4336-93ba-3b85a0015d12 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:38.238043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbca632-2e6a-48f7-a5cd-608b00e654ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:38.238659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbca632-2e6a-48f7-a5cd-608b00e654ff admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:38.238930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbca632-2e6a-48f7-a5cd-608b00e654ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:38.239201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbca632-2e6a-48f7-a5cd-608b00e654ff admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:38.239888 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbca632-2e6a-48f7-a5cd-608b00e654ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:38.241837 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbca632-2e6a-48f7-a5cd-608b00e654ff admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:38.322808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1273/2528] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:38 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:38.328176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077da73-b11d-4eee-91d9-4dd95ef388d7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:38.340090 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077da73-b11d-4eee-91d9-4dd95ef388d7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:38.345928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a7ba5-2b8d-404a-82fe-75ad2e3346f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:38.346567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a7ba5-2b8d-404a-82fe-75ad2e3346f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:38.346844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a7ba5-2b8d-404a-82fe-75ad2e3346f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:38.347222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a7ba5-2b8d-404a-82fe-75ad2e3346f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:38.348229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a7ba5-2b8d-404a-82fe-75ad2e3346f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:38.349961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a7ba5-2b8d-404a-82fe-75ad2e3346f8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:38.364641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1256/2529] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:38.365920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbca632-2e6a-48f7-a5cd-608b00e654ff admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:38.377684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbca632-2e6a-48f7-a5cd-608b00e654ff admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:38.383417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda4b8a-b77e-4421-bbde-f90f179f419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:38.386499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4b8a-b77e-4421-bbde-f90f179f419f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:38.386499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4b8a-b77e-4421-bbde-f90f179f419f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:38.386499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4b8a-b77e-4421-bbde-f90f179f419f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:38.386499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda4b8a-b77e-4421-bbde-f90f179f419f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:38.387399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda4b8a-b77e-4421-bbde-f90f179f419f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:38.401841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1274/2530] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:38.407269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a7ba5-2b8d-404a-82fe-75ad2e3346f8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:38.418761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a7ba5-2b8d-404a-82fe-75ad2e3346f8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:38.424965 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26746a-cc1d-4a05-a943-2a56ff456f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:38.425703 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26746a-cc1d-4a05-a943-2a56ff456f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:38.425988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26746a-cc1d-4a05-a943-2a56ff456f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:38.426429 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26746a-cc1d-4a05-a943-2a56ff456f81 admin admin] PATH_INFO: `/v3/projects/6197362b9c9a4ec68ed6eee48891cf28/users/a01586c80304449994e757b9f5f6b996/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:38.444487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26746a-cc1d-4a05-a943-2a56ff456f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6197362b9c9a4ec68ed6eee48891cf28, user_id=a01586c80304449994e757b9f5f6b996, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:38.447636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26746a-cc1d-4a05-a943-2a56ff456f81 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:38.579487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1257/2531] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:38 2022] PUT /identity/v3/projects/6197362b9c9a4ec68ed6eee48891cf28/users/a01586c80304449994e757b9f5f6b996/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:38.589783 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0432e9-7d98-411d-82b6-5b7f56a0a5b7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:38.590063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0432e9-7d98-411d-82b6-5b7f56a0a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:38.590378 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0432e9-7d98-411d-82b6-5b7f56a0a5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:38.618294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eb0432e9-7d98-411d-82b6-5b7f56a0a5b7 None None] MFA Rules not processed for user `a01586c80304449994e757b9f5f6b996`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:38.619489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eb0432e9-7d98-411d-82b6-5b7f56a0a5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:38.653399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:38.687407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1275/2532] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:44:38.691506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26746a-cc1d-4a05-a943-2a56ff456f81 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:38.755657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26746a-cc1d-4a05-a943-2a56ff456f81 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:38.760311 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d207d-6ede-4402-aa72-137570b02a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:38.760926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d207d-6ede-4402-aa72-137570b02a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:38.761231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d207d-6ede-4402-aa72-137570b02a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:38.761501 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d207d-6ede-4402-aa72-137570b02a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:38.762176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d207d-6ede-4402-aa72-137570b02a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:38.765298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d207d-6ede-4402-aa72-137570b02a7d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:38.864961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1258/2533] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:38 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:38.869040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0432e9-7d98-411d-82b6-5b7f56a0a5b7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:38.880277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0432e9-7d98-411d-82b6-5b7f56a0a5b7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:38.938467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955439b9-aa1c-4d5d-af7b-8db8a4f1ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:38.939084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955439b9-aa1c-4d5d-af7b-8db8a4f1ded6 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:38.939369 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955439b9-aa1c-4d5d-af7b-8db8a4f1ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:38.939646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955439b9-aa1c-4d5d-af7b-8db8a4f1ded6 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:38.940312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955439b9-aa1c-4d5d-af7b-8db8a4f1ded6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:38.942308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955439b9-aa1c-4d5d-af7b-8db8a4f1ded6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:39.040697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1276/2534] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:38 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:44:39.044724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d207d-6ede-4402-aa72-137570b02a7d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:39.055669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d207d-6ede-4402-aa72-137570b02a7d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:39.060525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18665fcf-a50c-4db3-8be2-dd211cbb01d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:39.061730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18665fcf-a50c-4db3-8be2-dd211cbb01d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:39.069150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18665fcf-a50c-4db3-8be2-dd211cbb01d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:39.069150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18665fcf-a50c-4db3-8be2-dd211cbb01d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:39.069150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18665fcf-a50c-4db3-8be2-dd211cbb01d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:39.069150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18665fcf-a50c-4db3-8be2-dd211cbb01d8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:39.076548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1259/2535] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:39.080817 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955439b9-aa1c-4d5d-af7b-8db8a4f1ded6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:39.090792 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955439b9-aa1c-4d5d-af7b-8db8a4f1ded6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:39.095533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15675d22-f1c8-478f-8bdc-9e749d860f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:39.096183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15675d22-f1c8-478f-8bdc-9e749d860f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:39.096489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15675d22-f1c8-478f-8bdc-9e749d860f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:39.096763 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15675d22-f1c8-478f-8bdc-9e749d860f82 admin admin] PATH_INFO: `/v3/projects/5c7d88efb095473d9d49792a9d24506e/users/cd8677d6e8214c0db7cb1a6ece02126d/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:39.112621 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15675d22-f1c8-478f-8bdc-9e749d860f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7d88efb095473d9d49792a9d24506e, user_id=cd8677d6e8214c0db7cb1a6ece02126d, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:39.115707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15675d22-f1c8-478f-8bdc-9e749d860f82 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:39.193180 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1277/2536] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:39 2022] PUT /identity/v3/projects/5c7d88efb095473d9d49792a9d24506e/users/cd8677d6e8214c0db7cb1a6ece02126d/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:39.197103 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18665fcf-a50c-4db3-8be2-dd211cbb01d8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:39.207085 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18665fcf-a50c-4db3-8be2-dd211cbb01d8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:39.214810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:39.264712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692d6ec-46bb-4247-b38d-1518545471df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:39.265532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692d6ec-46bb-4247-b38d-1518545471df admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:39.265814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692d6ec-46bb-4247-b38d-1518545471df admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:39.266089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692d6ec-46bb-4247-b38d-1518545471df admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:39.266771 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692d6ec-46bb-4247-b38d-1518545471df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:39.268372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692d6ec-46bb-4247-b38d-1518545471df admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:39.277959 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1260/2537] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:39.282227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15675d22-f1c8-478f-8bdc-9e749d860f82 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:39.292978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15675d22-f1c8-478f-8bdc-9e749d860f82 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:39.298415 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d8dcc-5264-4ee9-9781-2b88c02e442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:39.299080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8dcc-5264-4ee9-9781-2b88c02e442e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:39.299356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8dcc-5264-4ee9-9781-2b88c02e442e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:39.299629 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8dcc-5264-4ee9-9781-2b88c02e442e admin admin] PATH_INFO: `/v3/projects/5c7d88efb095473d9d49792a9d24506e/users/cd8677d6e8214c0db7cb1a6ece02126d/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:39.304390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8dcc-5264-4ee9-9781-2b88c02e442e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7d88efb095473d9d49792a9d24506e, user_id=cd8677d6e8214c0db7cb1a6ece02126d, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:39.304390 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8dcc-5264-4ee9-9781-2b88c02e442e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:39.315613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1278/2538] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:39 2022] PUT /identity/v3/projects/5c7d88efb095473d9d49792a9d24506e/users/cd8677d6e8214c0db7cb1a6ece02126d/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:39.327525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514710-35cb-4b7b-a432-49d5a5178f88 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:39.327802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514710-35cb-4b7b-a432-49d5a5178f88 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:39.328081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514710-35cb-4b7b-a432-49d5a5178f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:39.355513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-17514710-35cb-4b7b-a432-49d5a5178f88 None None] MFA Rules not processed for user `cd8677d6e8214c0db7cb1a6ece02126d`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:39.356713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-17514710-35cb-4b7b-a432-49d5a5178f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:39.424179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1261/2539] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:39.435649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d8dcc-5264-4ee9-9781-2b88c02e442e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:39.437478 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f10d8dcc-5264-4ee9-9781-2b88c02e442e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:39.495313 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d8dcc-5264-4ee9-9781-2b88c02e442e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:39.499436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90690e75-358c-4c27-b527-35b4055a0b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:39.500073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90690e75-358c-4c27-b527-35b4055a0b9b service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:39.500348 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90690e75-358c-4c27-b527-35b4055a0b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:39.500616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90690e75-358c-4c27-b527-35b4055a0b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:39.509878 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90690e75-358c-4c27-b527-35b4055a0b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:39.511403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90690e75-358c-4c27-b527-35b4055a0b9b service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:39.521804 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1279/2540] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:39.588268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17514710-35cb-4b7b-a432-49d5a5178f88 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:39.650326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17514710-35cb-4b7b-a432-49d5a5178f88 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:39.655586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:39.656275 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:39.656559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:39.656834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] PATH_INFO: `/v3/users/a01586c80304449994e757b9f5f6b996` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:39.658036 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01586c80304449994e757b9f5f6b996)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:39.659973 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:39.880686 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:39.889968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01586c80304449994e757b9f5f6b996'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:39.966248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01586c80304449994e757b9f5f6b996'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:39.967505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01586c80304449994e757b9f5f6b996'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:39.968451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01586c80304449994e757b9f5f6b996'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:39.980635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01586c80304449994e757b9f5f6b996'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:39.993443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1262/2541] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:39 2022] DELETE /identity/v3/users/a01586c80304449994e757b9f5f6b996 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:39.997985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bd795-8195-45ec-a647-d13cf2e005d3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:39.998458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bd795-8195-45ec-a647-d13cf2e005d3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:39.998671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bd795-8195-45ec-a647-d13cf2e005d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:40.017692 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-737bd795-8195-45ec-a647-d13cf2e005d3 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:40.018902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-737bd795-8195-45ec-a647-d13cf2e005d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:40.049947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:40.086121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1280/2542] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:40.098929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:40.100384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:40.158695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18055ca-a7f7-4f98-a3ba-9b2f7eceba00 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:40.162884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481103a0-e838-472e-915c-51ff819121b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:40.163585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481103a0-e838-472e-915c-51ff819121b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:40.163945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481103a0-e838-472e-915c-51ff819121b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:40.164296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481103a0-e838-472e-915c-51ff819121b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:40.174422 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481103a0-e838-472e-915c-51ff819121b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:40.176016 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481103a0-e838-472e-915c-51ff819121b7 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:40.186329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1263/2543] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:40.631612 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bd795-8195-45ec-a647-d13cf2e005d3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:40.633210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-737bd795-8195-45ec-a647-d13cf2e005d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:40.646096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bd795-8195-45ec-a647-d13cf2e005d3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:40.651033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:40.651676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:40.651959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:40.652236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] PATH_INFO: `/v3/projects/6197362b9c9a4ec68ed6eee48891cf28` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:40.653471 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6197362b9c9a4ec68ed6eee48891cf28)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:40.656043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:40.754747 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6197362b9c9a4ec68ed6eee48891cf28', 'request_id': 'req-d332d3ce-9695-4c29-aa57-de42a145464e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:40.760926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6197362b9c9a4ec68ed6eee48891cf28', 'request_id': 'req-d332d3ce-9695-4c29-aa57-de42a145464e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:40.766793 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6197362b9c9a4ec68ed6eee48891cf28', 'request_id': 'req-d332d3ce-9695-4c29-aa57-de42a145464e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:40.837929 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] The token cache is being invalidate because project 6197362b9c9a4ec68ed6eee48891cf28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:40.838205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:40.838848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:40.840357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1281/2544] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:40 2022] DELETE /identity/v3/projects/6197362b9c9a4ec68ed6eee48891cf28 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:40.845013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481103a0-e838-472e-915c-51ff819121b7 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:40.854621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481103a0-e838-472e-915c-51ff819121b7 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:40.909805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa859d-7345-4833-a9af-fab38f288c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:40.910359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa859d-7345-4833-a9af-fab38f288c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:40.910664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa859d-7345-4833-a9af-fab38f288c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:40.910918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa859d-7345-4833-a9af-fab38f288c81 admin admin] PATH_INFO: `/v3/users/cd8677d6e8214c0db7cb1a6ece02126d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:40.912322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa859d-7345-4833-a9af-fab38f288c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8677d6e8214c0db7cb1a6ece02126d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:40.914271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa859d-7345-4833-a9af-fab38f288c81 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:41.149846 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c2fa859d-7345-4833-a9af-fab38f288c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8677d6e8214c0db7cb1a6ece02126d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:41.223229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c2fa859d-7345-4833-a9af-fab38f288c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8677d6e8214c0db7cb1a6ece02126d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:41.223887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c2fa859d-7345-4833-a9af-fab38f288c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8677d6e8214c0db7cb1a6ece02126d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:41.224499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c2fa859d-7345-4833-a9af-fab38f288c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8677d6e8214c0db7cb1a6ece02126d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:41.226782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:41.237623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c2fa859d-7345-4833-a9af-fab38f288c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8677d6e8214c0db7cb1a6ece02126d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:41.250130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1264/2545] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:40 2022] DELETE /identity/v3/users/cd8677d6e8214c0db7cb1a6ece02126d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:41.698275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:41.699789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:41.713343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332d3ce-9695-4c29-aa57-de42a145464e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:41.775356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:41.776012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:41.776280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:41.776868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] PATH_INFO: `/v3/projects/5c7d88efb095473d9d49792a9d24506e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:41.777882 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7d88efb095473d9d49792a9d24506e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:41.779941 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:41.900025 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7d88efb095473d9d49792a9d24506e', 'request_id': 'req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:41.906614 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7d88efb095473d9d49792a9d24506e', 'request_id': 'req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:41.909054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:41.913212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7d88efb095473d9d49792a9d24506e', 'request_id': 'req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:42.032762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] The token cache is being invalidate because project 5c7d88efb095473d9d49792a9d24506e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:42.033055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:42.033726 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f6a931b9-a4ae-4cd3-adb3-6de478535dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:42.035251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1282/2546] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:41 2022] DELETE /identity/v3/projects/5c7d88efb095473d9d49792a9d24506e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:42.040433 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39b475-6c33-4423-a82a-742ca8dda1ab None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:42.040887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39b475-6c33-4423-a82a-742ca8dda1ab None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:42.041008 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39b475-6c33-4423-a82a-742ca8dda1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:42.061767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8d39b475-6c33-4423-a82a-742ca8dda1ab None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:42.063037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8d39b475-6c33-4423-a82a-742ca8dda1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:42.121580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1265/2547] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:42.130143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcae514-4012-4ae2-bf5d-c87e79358e67 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:42.130431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcae514-4012-4ae2-bf5d-c87e79358e67 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:42.130708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcae514-4012-4ae2-bf5d-c87e79358e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:42.151113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1fcae514-4012-4ae2-bf5d-c87e79358e67 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:42.152353 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1fcae514-4012-4ae2-bf5d-c87e79358e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:42.166313 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1283/2548] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:42.171163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39b475-6c33-4423-a82a-742ca8dda1ab None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:42.180745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39b475-6c33-4423-a82a-742ca8dda1ab None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:42.185406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463f5ab-2aa8-4304-a61a-936476e379cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:42.186042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463f5ab-2aa8-4304-a61a-936476e379cc admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:42.191611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463f5ab-2aa8-4304-a61a-936476e379cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:42.191611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463f5ab-2aa8-4304-a61a-936476e379cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:42.191611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463f5ab-2aa8-4304-a61a-936476e379cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:44:42.191611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463f5ab-2aa8-4304-a61a-936476e379cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:42.191611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463f5ab-2aa8-4304-a61a-936476e379cc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:42.200740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1266/2549] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:44:42.205248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcae514-4012-4ae2-bf5d-c87e79358e67 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:42.214477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcae514-4012-4ae2-bf5d-c87e79358e67 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:42.219702 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2206b-66d9-4113-a7dc-50810a2c9359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:42.220311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2206b-66d9-4113-a7dc-50810a2c9359 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:42.223784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2206b-66d9-4113-a7dc-50810a2c9359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:42.223784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2206b-66d9-4113-a7dc-50810a2c9359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:42.223784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2206b-66d9-4113-a7dc-50810a2c9359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:42.223784 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2206b-66d9-4113-a7dc-50810a2c9359 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:42.323421 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1284/2550] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:42 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:44:42.330152 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463f5ab-2aa8-4304-a61a-936476e379cc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:42.339900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463f5ab-2aa8-4304-a61a-936476e379cc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:42.396230 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d716f2-4b32-4a78-a33d-cfa4840c9904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:42.396847 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d716f2-4b32-4a78-a33d-cfa4840c9904 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:42.397146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d716f2-4b32-4a78-a33d-cfa4840c9904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:42.397432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d716f2-4b32-4a78-a33d-cfa4840c9904 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:42.398097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d716f2-4b32-4a78-a33d-cfa4840c9904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:42.400060 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d716f2-4b32-4a78-a33d-cfa4840c9904 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:42.498126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1267/2551] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:42 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:42.502917 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2206b-66d9-4113-a7dc-50810a2c9359 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:42.513220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2206b-66d9-4113-a7dc-50810a2c9359 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:42.518672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279c14-71fe-43e6-bb52-32c8d9c31752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:42.519334 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279c14-71fe-43e6-bb52-32c8d9c31752 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:42.519564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279c14-71fe-43e6-bb52-32c8d9c31752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:42.519841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279c14-71fe-43e6-bb52-32c8d9c31752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:42.520533 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6279c14-71fe-43e6-bb52-32c8d9c31752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:42.522158 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6279c14-71fe-43e6-bb52-32c8d9c31752 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:42.532116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1285/2552] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:42.535994 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d716f2-4b32-4a78-a33d-cfa4840c9904 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:42.547655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d716f2-4b32-4a78-a33d-cfa4840c9904 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:42.552301 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273300f1-8fca-4828-b33a-6df833927990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:42.552897 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273300f1-8fca-4828-b33a-6df833927990 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:42.553209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273300f1-8fca-4828-b33a-6df833927990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:42.553538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273300f1-8fca-4828-b33a-6df833927990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:42.554223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273300f1-8fca-4828-b33a-6df833927990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:42.555841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273300f1-8fca-4828-b33a-6df833927990 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:42.572859 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1268/2553] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:42.575892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279c14-71fe-43e6-bb52-32c8d9c31752 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:42.586279 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279c14-71fe-43e6-bb52-32c8d9c31752 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:42.591078 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49763f-5a74-4c19-8760-b51a58cbffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:42.591820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49763f-5a74-4c19-8760-b51a58cbffbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:42.592178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49763f-5a74-4c19-8760-b51a58cbffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:42.592538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49763f-5a74-4c19-8760-b51a58cbffbc admin admin] PATH_INFO: `/v3/projects/849737aa3e014eaeb874c2046a950a04/users/2f8bedc9a4fc4693b4444d54f0b85966/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:42.609527 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49763f-5a74-4c19-8760-b51a58cbffbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=849737aa3e014eaeb874c2046a950a04, user_id=2f8bedc9a4fc4693b4444d54f0b85966, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:42.612252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49763f-5a74-4c19-8760-b51a58cbffbc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:42.705114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1286/2554] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:42 2022] PUT /identity/v3/projects/849737aa3e014eaeb874c2046a950a04/users/2f8bedc9a4fc4693b4444d54f0b85966/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:42.715641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d8e0d-6569-43b0-a705-86bfdfaec201 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:42.716222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d8e0d-6569-43b0-a705-86bfdfaec201 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:42.716499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d8e0d-6569-43b0-a705-86bfdfaec201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:42.745677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d54d8e0d-6569-43b0-a705-86bfdfaec201 None None] MFA Rules not processed for user `2f8bedc9a4fc4693b4444d54f0b85966`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:42.746887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d54d8e0d-6569-43b0-a705-86bfdfaec201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:42.776509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:42.811843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1269/2555] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:44:42.816506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49763f-5a74-4c19-8760-b51a58cbffbc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:42.879307 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49763f-5a74-4c19-8760-b51a58cbffbc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:42.883909 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f72e5-a3ad-404f-980d-10128942d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:42.884525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f72e5-a3ad-404f-980d-10128942d500 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:42.884793 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f72e5-a3ad-404f-980d-10128942d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:42.885063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f72e5-a3ad-404f-980d-10128942d500 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:42.885743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f72e5-a3ad-404f-980d-10128942d500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:42.887624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f72e5-a3ad-404f-980d-10128942d500 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:42.995062 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1287/2556] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:42 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:42.996280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d8e0d-6569-43b0-a705-86bfdfaec201 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:43.007363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d8e0d-6569-43b0-a705-86bfdfaec201 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:43.064518 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dbdff-c157-45e7-be96-179d0b99550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:43.065159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbdff-c157-45e7-be96-179d0b99550e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:43.065438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbdff-c157-45e7-be96-179d0b99550e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:43.065712 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbdff-c157-45e7-be96-179d0b99550e admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:43.066371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dbdff-c157-45e7-be96-179d0b99550e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:43.068300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dbdff-c157-45e7-be96-179d0b99550e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:43.182313 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1270/2557] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:42 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:43.187207 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f72e5-a3ad-404f-980d-10128942d500 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:43.199448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f72e5-a3ad-404f-980d-10128942d500 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:43.221777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615852cd-bc35-4ebb-85ec-396bff26e04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:43.221777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615852cd-bc35-4ebb-85ec-396bff26e04d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:43.221777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615852cd-bc35-4ebb-85ec-396bff26e04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:43.221777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615852cd-bc35-4ebb-85ec-396bff26e04d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:43.222216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615852cd-bc35-4ebb-85ec-396bff26e04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:43.222216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615852cd-bc35-4ebb-85ec-396bff26e04d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:43.222216 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1288/2558] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:43.225902 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dbdff-c157-45e7-be96-179d0b99550e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:43.236200 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dbdff-c157-45e7-be96-179d0b99550e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:43.240985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d020453-49dd-49ff-9d45-703d4bdc70e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:43.241668 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d020453-49dd-49ff-9d45-703d4bdc70e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:43.241949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d020453-49dd-49ff-9d45-703d4bdc70e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:43.242223 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d020453-49dd-49ff-9d45-703d4bdc70e0 admin admin] PATH_INFO: `/v3/projects/b1067587286546818191e599e90f63f2/users/ecd13c4fb6084e00a17de75ba3d8cad3/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:43.257582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d020453-49dd-49ff-9d45-703d4bdc70e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1067587286546818191e599e90f63f2, user_id=ecd13c4fb6084e00a17de75ba3d8cad3, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:43.260268 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d020453-49dd-49ff-9d45-703d4bdc70e0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:43.412655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1271/2559] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:43 2022] PUT /identity/v3/projects/b1067587286546818191e599e90f63f2/users/ecd13c4fb6084e00a17de75ba3d8cad3/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:43.416750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615852cd-bc35-4ebb-85ec-396bff26e04d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:43.427347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615852cd-bc35-4ebb-85ec-396bff26e04d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:43.478164 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:43.485666 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d99281-9df9-4eec-9ded-a6d607927a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:43.486280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d99281-9df9-4eec-9ded-a6d607927a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:43.486561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d99281-9df9-4eec-9ded-a6d607927a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:43.486833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d99281-9df9-4eec-9ded-a6d607927a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:43.487514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d99281-9df9-4eec-9ded-a6d607927a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:43.489117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d99281-9df9-4eec-9ded-a6d607927a1e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:43.499070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1289/2560] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:43.503354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d020453-49dd-49ff-9d45-703d4bdc70e0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:43.513715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d020453-49dd-49ff-9d45-703d4bdc70e0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:43.518924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0218686-edb0-4b5d-8272-e2fa590bb2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:43.519544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0218686-edb0-4b5d-8272-e2fa590bb2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:43.519921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0218686-edb0-4b5d-8272-e2fa590bb2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:43.520197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0218686-edb0-4b5d-8272-e2fa590bb2e8 admin admin] PATH_INFO: `/v3/projects/b1067587286546818191e599e90f63f2/users/ecd13c4fb6084e00a17de75ba3d8cad3/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:43.522328 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0218686-edb0-4b5d-8272-e2fa590bb2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1067587286546818191e599e90f63f2, user_id=ecd13c4fb6084e00a17de75ba3d8cad3, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:43.525220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0218686-edb0-4b5d-8272-e2fa590bb2e8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:43.537158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1272/2561] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:43 2022] PUT /identity/v3/projects/b1067587286546818191e599e90f63f2/users/ecd13c4fb6084e00a17de75ba3d8cad3/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:43.550049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117c2c-2894-4fe5-979e-491f79872752 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:43.552996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117c2c-2894-4fe5-979e-491f79872752 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:43.552996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117c2c-2894-4fe5-979e-491f79872752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:43.580265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-70117c2c-2894-4fe5-979e-491f79872752 None None] MFA Rules not processed for user `ecd13c4fb6084e00a17de75ba3d8cad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:43.583679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-70117c2c-2894-4fe5-979e-491f79872752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:43.650345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1290/2562] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:43.662158 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0218686-edb0-4b5d-8272-e2fa590bb2e8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:43.664200 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b0218686-edb0-4b5d-8272-e2fa590bb2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:43.722918 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0218686-edb0-4b5d-8272-e2fa590bb2e8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:43.726678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa9ac-fb83-48f6-bf37-e462bd202dd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:43.730588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa9ac-fb83-48f6-bf37-e462bd202dd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:43.730588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa9ac-fb83-48f6-bf37-e462bd202dd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:43.730588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa9ac-fb83-48f6-bf37-e462bd202dd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:43.737482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aa9ac-fb83-48f6-bf37-e462bd202dd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:43.738925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aa9ac-fb83-48f6-bf37-e462bd202dd0 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:43.748504 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1273/2563] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:43.850164 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70117c2c-2894-4fe5-979e-491f79872752 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:43.860366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70117c2c-2894-4fe5-979e-491f79872752 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:43.864088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c03632-73fb-4114-8687-d04869ffd1fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:43.864697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c03632-73fb-4114-8687-d04869ffd1fd service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:43.864977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c03632-73fb-4114-8687-d04869ffd1fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:43.865280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c03632-73fb-4114-8687-d04869ffd1fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:43.921075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c03632-73fb-4114-8687-d04869ffd1fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:43.923169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c03632-73fb-4114-8687-d04869ffd1fd service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:43.932146 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1291/2564] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:44.357019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa9ac-fb83-48f6-bf37-e462bd202dd0 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:44.362770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-169aa9ac-fb83-48f6-bf37-e462bd202dd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:44.387632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:44.426967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa9ac-fb83-48f6-bf37-e462bd202dd0 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:44.431486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:44.432121 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:44.432402 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:44.432737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] PATH_INFO: `/v3/users/b0730c925c824388a2aa61abb5379cfd` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:44.433948 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0730c925c824388a2aa61abb5379cfd)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:44.437447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:44.619146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0730c925c824388a2aa61abb5379cfd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:44.684545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0730c925c824388a2aa61abb5379cfd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:44.685242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0730c925c824388a2aa61abb5379cfd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:44.685881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0730c925c824388a2aa61abb5379cfd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:44.699938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0730c925c824388a2aa61abb5379cfd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:44.712544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1274/2565] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:44 2022] DELETE /identity/v3/users/b0730c925c824388a2aa61abb5379cfd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:44.717075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c3ad-e916-4103-854c-d2e2020e74fb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:44.717475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c3ad-e916-4103-854c-d2e2020e74fb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:44.717818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c3ad-e916-4103-854c-d2e2020e74fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:44.737683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bae9c3ad-e916-4103-854c-d2e2020e74fb None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:44.738886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bae9c3ad-e916-4103-854c-d2e2020e74fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:44.799423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1292/2566] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:44:44.809199 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:44.810587 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:44.868239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d2a0-5e10-4476-8971-9b7fb231ec4c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:44.871964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea5caf-37b9-4335-b664-7d35f9ae5c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:44.872580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea5caf-37b9-4335-b664-7d35f9ae5c3c service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:44.872862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea5caf-37b9-4335-b664-7d35f9ae5c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:44.873154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea5caf-37b9-4335-b664-7d35f9ae5c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:44.882936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea5caf-37b9-4335-b664-7d35f9ae5c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:44.884389 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea5caf-37b9-4335-b664-7d35f9ae5c3c service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:44.893840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1275/2567] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:45.276387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c3ad-e916-4103-854c-d2e2020e74fb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:45.277946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bae9c3ad-e916-4103-854c-d2e2020e74fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:45.292460 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c3ad-e916-4103-854c-d2e2020e74fb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:45.298135 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:45.299409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:45.299873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:45.300157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] PATH_INFO: `/v3/projects/3151e60599ab47ab938786d9f899d03a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:45.305068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3151e60599ab47ab938786d9f899d03a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:45.305068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:45.315033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:45.416235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3151e60599ab47ab938786d9f899d03a', 'request_id': 'req-0b0ac1dc-ed02-491e-9313-71933f2bba82'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:45.423092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3151e60599ab47ab938786d9f899d03a', 'request_id': 'req-0b0ac1dc-ed02-491e-9313-71933f2bba82'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:45.428549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3151e60599ab47ab938786d9f899d03a', 'request_id': 'req-0b0ac1dc-ed02-491e-9313-71933f2bba82'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:45.506831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] The token cache is being invalidate because project 3151e60599ab47ab938786d9f899d03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:45.507124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:45.507814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:45.509354 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1293/2568] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:45 2022] DELETE /identity/v3/projects/3151e60599ab47ab938786d9f899d03a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:45.513379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea5caf-37b9-4335-b664-7d35f9ae5c3c service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:45.523720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea5caf-37b9-4335-b664-7d35f9ae5c3c service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:45.567961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:45.579976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260efab5-8b2a-4368-ad53-f017248bd2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:45.580606 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260efab5-8b2a-4368-ad53-f017248bd2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:45.580889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260efab5-8b2a-4368-ad53-f017248bd2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:45.581191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260efab5-8b2a-4368-ad53-f017248bd2b1 admin admin] PATH_INFO: `/v3/users/6f8f6180e3e9485e99ddc29e7b6e3aa0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:45.582351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260efab5-8b2a-4368-ad53-f017248bd2b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8f6180e3e9485e99ddc29e7b6e3aa0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:45.584266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260efab5-8b2a-4368-ad53-f017248bd2b1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:45.764971 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-260efab5-8b2a-4368-ad53-f017248bd2b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8f6180e3e9485e99ddc29e7b6e3aa0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:45.845454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-260efab5-8b2a-4368-ad53-f017248bd2b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8f6180e3e9485e99ddc29e7b6e3aa0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:45.846072 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-260efab5-8b2a-4368-ad53-f017248bd2b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8f6180e3e9485e99ddc29e7b6e3aa0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:45.846766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-260efab5-8b2a-4368-ad53-f017248bd2b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8f6180e3e9485e99ddc29e7b6e3aa0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:45.859518 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-260efab5-8b2a-4368-ad53-f017248bd2b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8f6180e3e9485e99ddc29e7b6e3aa0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:45.871515 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1276/2569] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:45 2022] DELETE /identity/v3/users/6f8f6180e3e9485e99ddc29e7b6e3aa0 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:46.305282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:46.305282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:46.315851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ac1dc-ed02-491e-9313-71933f2bba82 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:46.377006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:46.377690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:46.377971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:46.378244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] PATH_INFO: `/v3/projects/07c11ece77c4410ea3c8c6b3e3a36fb4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:46.379487 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c11ece77c4410ea3c8c6b3e3a36fb4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:46.381564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:46.508835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c11ece77c4410ea3c8c6b3e3a36fb4', 'request_id': 'req-427d5327-caf5-4fb5-8531-5bc259116b34'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:46.516145 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c11ece77c4410ea3c8c6b3e3a36fb4', 'request_id': 'req-427d5327-caf5-4fb5-8531-5bc259116b34'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:46.522010 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c11ece77c4410ea3c8c6b3e3a36fb4', 'request_id': 'req-427d5327-caf5-4fb5-8531-5bc259116b34'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:46.611547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] The token cache is being invalidate because project 07c11ece77c4410ea3c8c6b3e3a36fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:46.611836 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:46.612461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-427d5327-caf5-4fb5-8531-5bc259116b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:46.614038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1294/2570] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:46 2022] DELETE /identity/v3/projects/07c11ece77c4410ea3c8c6b3e3a36fb4 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:46.618970 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68dd97-b347-4cf3-bd68-fe57c5ad2781 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:46.619454 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68dd97-b347-4cf3-bd68-fe57c5ad2781 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:46.619562 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68dd97-b347-4cf3-bd68-fe57c5ad2781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:46.640912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9d68dd97-b347-4cf3-bd68-fe57c5ad2781 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:46.642266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9d68dd97-b347-4cf3-bd68-fe57c5ad2781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:46.702359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1277/2571] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:46.710746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc42199-ad64-41bd-8d0c-66683749792f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:46.711127 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc42199-ad64-41bd-8d0c-66683749792f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:46.711407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc42199-ad64-41bd-8d0c-66683749792f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:46.731899 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cfc42199-ad64-41bd-8d0c-66683749792f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:46.733032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cfc42199-ad64-41bd-8d0c-66683749792f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:46.741093 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1295/2572] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:46.745227 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68dd97-b347-4cf3-bd68-fe57c5ad2781 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:46.755597 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68dd97-b347-4cf3-bd68-fe57c5ad2781 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:46.760179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7ca2c-e08c-4537-b8d5-c9f5312b95ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:46.760781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7ca2c-e08c-4537-b8d5-c9f5312b95ad admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:46.761063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7ca2c-e08c-4537-b8d5-c9f5312b95ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:46.761370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7ca2c-e08c-4537-b8d5-c9f5312b95ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:46.762094 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7ca2c-e08c-4537-b8d5-c9f5312b95ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:44:46.762397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7ca2c-e08c-4537-b8d5-c9f5312b95ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:46.764015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7ca2c-e08c-4537-b8d5-c9f5312b95ad admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:46.776156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1278/2573] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:44:46.780303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc42199-ad64-41bd-8d0c-66683749792f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:46.790379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc42199-ad64-41bd-8d0c-66683749792f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:46.794996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c23e8-16b8-476d-88ef-c9955c43e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:46.795590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c23e8-16b8-476d-88ef-c9955c43e81b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:46.795869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c23e8-16b8-476d-88ef-c9955c43e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:46.796139 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c23e8-16b8-476d-88ef-c9955c43e81b admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:46.797594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c23e8-16b8-476d-88ef-c9955c43e81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:46.799483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c23e8-16b8-476d-88ef-c9955c43e81b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:46.869717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:46.875826 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1296/2574] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:46 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:46.879930 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7ca2c-e08c-4537-b8d5-c9f5312b95ad admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:46.889654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7ca2c-e08c-4537-b8d5-c9f5312b95ad admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:46.940493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:46.949155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de687-04f6-4de9-8141-b597dbd3b4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:46.949815 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de687-04f6-4de9-8141-b597dbd3b4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:46.950097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de687-04f6-4de9-8141-b597dbd3b4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:46.950365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de687-04f6-4de9-8141-b597dbd3b4e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:46.951014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271de687-04f6-4de9-8141-b597dbd3b4e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:46.953253 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271de687-04f6-4de9-8141-b597dbd3b4e5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:47.042330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c23e8-16b8-476d-88ef-c9955c43e81b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:47.044045 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc7c23e8-16b8-476d-88ef-c9955c43e81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:47.052958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1279/2575] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:46 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:47.056992 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de687-04f6-4de9-8141-b597dbd3b4e5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:47.057440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c23e8-16b8-476d-88ef-c9955c43e81b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:47.061988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f551f-9c2a-433b-9eb9-88072fc30d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:47.062918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f551f-9c2a-433b-9eb9-88072fc30d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:47.063618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f551f-9c2a-433b-9eb9-88072fc30d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:47.063618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f551f-9c2a-433b-9eb9-88072fc30d42 admin admin] PATH_INFO: `/v3/users/2f8bedc9a4fc4693b4444d54f0b85966` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:47.064621 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f551f-9c2a-433b-9eb9-88072fc30d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8bedc9a4fc4693b4444d54f0b85966)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:47.066566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f551f-9c2a-433b-9eb9-88072fc30d42 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:47.067876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de687-04f6-4de9-8141-b597dbd3b4e5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:47.072860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09070a-851c-4b99-8382-c48e63508cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:47.073490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09070a-851c-4b99-8382-c48e63508cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:47.073774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09070a-851c-4b99-8382-c48e63508cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:47.074047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09070a-851c-4b99-8382-c48e63508cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:47.074767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09070a-851c-4b99-8382-c48e63508cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:47.076344 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09070a-851c-4b99-8382-c48e63508cb0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:47.089561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1280/2576] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:44:47.094161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09070a-851c-4b99-8382-c48e63508cb0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:47.104138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09070a-851c-4b99-8382-c48e63508cb0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:47.109608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754078f-26c6-4fb0-8e0a-3ea2a531458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:47.110189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754078f-26c6-4fb0-8e0a-3ea2a531458a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:47.110470 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754078f-26c6-4fb0-8e0a-3ea2a531458a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:47.110741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754078f-26c6-4fb0-8e0a-3ea2a531458a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:47.111416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754078f-26c6-4fb0-8e0a-3ea2a531458a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:47.113026 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754078f-26c6-4fb0-8e0a-3ea2a531458a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:47.123116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1281/2577] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:44:47.127615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754078f-26c6-4fb0-8e0a-3ea2a531458a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:47.137630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754078f-26c6-4fb0-8e0a-3ea2a531458a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:47.143336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0086e-337f-434a-bc51-4882b3613d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:47.143990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0086e-337f-434a-bc51-4882b3613d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:47.144302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0086e-337f-434a-bc51-4882b3613d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:47.144576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0086e-337f-434a-bc51-4882b3613d1e admin admin] PATH_INFO: `/v3/projects/48f010461b634944a22351b110e65fc3/users/126c021cc81e4c81b7e4d91da80e2fdd/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:47.159742 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0086e-337f-434a-bc51-4882b3613d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f010461b634944a22351b110e65fc3, user_id=126c021cc81e4c81b7e4d91da80e2fdd, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:47.163136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0086e-337f-434a-bc51-4882b3613d1e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:47.229873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-615f551f-9c2a-433b-9eb9-88072fc30d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8bedc9a4fc4693b4444d54f0b85966'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:47.230653 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-615f551f-9c2a-433b-9eb9-88072fc30d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8bedc9a4fc4693b4444d54f0b85966'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:47.250760 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1282/2578] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:47 2022] PUT /identity/v3/projects/48f010461b634944a22351b110e65fc3/users/126c021cc81e4c81b7e4d91da80e2fdd/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:47.261384 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a5f4b-d651-4ccf-908d-871a505160bf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:47.261682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a5f4b-d651-4ccf-908d-871a505160bf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:47.261954 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a5f4b-d651-4ccf-908d-871a505160bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:47.290197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cc0a5f4b-d651-4ccf-908d-871a505160bf None None] MFA Rules not processed for user `126c021cc81e4c81b7e4d91da80e2fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:47.291347 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cc0a5f4b-d651-4ccf-908d-871a505160bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:47.295464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-615f551f-9c2a-433b-9eb9-88072fc30d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8bedc9a4fc4693b4444d54f0b85966'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:47.299955 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-615f551f-9c2a-433b-9eb9-88072fc30d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8bedc9a4fc4693b4444d54f0b85966'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:47.309176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-615f551f-9c2a-433b-9eb9-88072fc30d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8bedc9a4fc4693b4444d54f0b85966'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:47.322671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1297/2579] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:47 2022] DELETE /identity/v3/users/2f8bedc9a4fc4693b4444d54f0b85966 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:47.328366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcfb1f-9fd8-4930-825c-50c6468f0b6d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:47.328366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcfb1f-9fd8-4930-825c-50c6468f0b6d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:47.328590 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcfb1f-9fd8-4930-825c-50c6468f0b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:47.348906 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-75dcfb1f-9fd8-4930-825c-50c6468f0b6d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:47.350152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-75dcfb1f-9fd8-4930-825c-50c6468f0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:47.364086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1283/2580] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:44:47.372204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a5f4b-d651-4ccf-908d-871a505160bf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:47.373609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cc0a5f4b-d651-4ccf-908d-871a505160bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:47.413014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1298/2581] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:44:47.424052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcfb1f-9fd8-4930-825c-50c6468f0b6d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:47.425399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-75dcfb1f-9fd8-4930-825c-50c6468f0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:47.432159 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a5f4b-d651-4ccf-908d-871a505160bf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:47.471819 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:47.480664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd1ae5-fb45-4ee6-b9f3-0291b50db72c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8753f3c218248abbf8018056c67b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:47.486453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd1ae5-fb45-4ee6-b9f3-0291b50db72c service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:47.486453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd1ae5-fb45-4ee6-b9f3-0291b50db72c service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:47.486453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd1ae5-fb45-4ee6-b9f3-0291b50db72c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:47.486774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcfb1f-9fd8-4930-825c-50c6468f0b6d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:47.488486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bce99-0ebf-4c72-a6c6-7383433a3983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:47.489100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bce99-0ebf-4c72-a6c6-7383433a3983 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:47.489412 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bce99-0ebf-4c72-a6c6-7383433a3983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:47.489686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bce99-0ebf-4c72-a6c6-7383433a3983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:47.498788 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bce99-0ebf-4c72-a6c6-7383433a3983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:47.500373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bce99-0ebf-4c72-a6c6-7383433a3983 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:47.509986 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1299/2582] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:44:47.539468 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd1ae5-fb45-4ee6-b9f3-0291b50db72c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:47.541076 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd1ae5-fb45-4ee6-b9f3-0291b50db72c service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:47.550319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1284/2583] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:44:47.973745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bce99-0ebf-4c72-a6c6-7383433a3983 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:47.975241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aa0bce99-0ebf-4c72-a6c6-7383433a3983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:47.989372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bce99-0ebf-4c72-a6c6-7383433a3983 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:47.994193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:47.994871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:47.995200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:47.995479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] PATH_INFO: `/v3/projects/849737aa3e014eaeb874c2046a950a04` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:47.996650 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=849737aa3e014eaeb874c2046a950a04)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:47.998610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:48.010627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:48.086215 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849737aa3e014eaeb874c2046a950a04', 'request_id': 'req-4e483174-3dbe-4300-81ea-98c961699cf5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:48.092382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849737aa3e014eaeb874c2046a950a04', 'request_id': 'req-4e483174-3dbe-4300-81ea-98c961699cf5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:48.098227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849737aa3e014eaeb874c2046a950a04', 'request_id': 'req-4e483174-3dbe-4300-81ea-98c961699cf5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:48.181143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] The token cache is being invalidate because project 849737aa3e014eaeb874c2046a950a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:48.181799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:48.182080 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:48.183606 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1300/2584] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:47 2022] DELETE /identity/v3/projects/849737aa3e014eaeb874c2046a950a04 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:48.188534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd1ae5-fb45-4ee6-b9f3-0291b50db72c service glance] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:48.199354 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd1ae5-fb45-4ee6-b9f3-0291b50db72c service glance] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:48.256248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac94b9-f2a6-41a7-a130-e9cf3996cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:48.256939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac94b9-f2a6-41a7-a130-e9cf3996cb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:48.257264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac94b9-f2a6-41a7-a130-e9cf3996cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:48.257539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac94b9-f2a6-41a7-a130-e9cf3996cb2e admin admin] PATH_INFO: `/v3/users/ecd13c4fb6084e00a17de75ba3d8cad3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:48.258807 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac94b9-f2a6-41a7-a130-e9cf3996cb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd13c4fb6084e00a17de75ba3d8cad3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:48.260755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac94b9-f2a6-41a7-a130-e9cf3996cb2e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:48.459875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-05ac94b9-f2a6-41a7-a130-e9cf3996cb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd13c4fb6084e00a17de75ba3d8cad3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:48.553334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-05ac94b9-f2a6-41a7-a130-e9cf3996cb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd13c4fb6084e00a17de75ba3d8cad3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:48.553962 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-05ac94b9-f2a6-41a7-a130-e9cf3996cb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd13c4fb6084e00a17de75ba3d8cad3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:48.554579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-05ac94b9-f2a6-41a7-a130-e9cf3996cb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd13c4fb6084e00a17de75ba3d8cad3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:48.568546 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-05ac94b9-f2a6-41a7-a130-e9cf3996cb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd13c4fb6084e00a17de75ba3d8cad3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:48.582334 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1285/2585] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:48 2022] DELETE /identity/v3/users/ecd13c4fb6084e00a17de75ba3d8cad3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:49.057945 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:49.061939 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:49.074319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e483174-3dbe-4300-81ea-98c961699cf5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:49.137209 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:49.137857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:49.138134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:49.138419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] PATH_INFO: `/v3/projects/b1067587286546818191e599e90f63f2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:49.139545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1067587286546818191e599e90f63f2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:49.141676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:49.284389 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1067587286546818191e599e90f63f2', 'request_id': 'req-32f8655a-9856-4dea-86cf-fee8955d6ce9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:49.291282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1067587286546818191e599e90f63f2', 'request_id': 'req-32f8655a-9856-4dea-86cf-fee8955d6ce9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:49.297625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1067587286546818191e599e90f63f2', 'request_id': 'req-32f8655a-9856-4dea-86cf-fee8955d6ce9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:49.393219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] The token cache is being invalidate because project b1067587286546818191e599e90f63f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:49.393515 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:49.394141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-32f8655a-9856-4dea-86cf-fee8955d6ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:49.398375 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1301/2586] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:49 2022] DELETE /identity/v3/projects/b1067587286546818191e599e90f63f2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:49.401098 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628cc1-4b4f-49c1-90af-c3bf07a15a68 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:49.402092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628cc1-4b4f-49c1-90af-c3bf07a15a68 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:49.402552 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628cc1-4b4f-49c1-90af-c3bf07a15a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:49.424633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-78628cc1-4b4f-49c1-90af-c3bf07a15a68 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:49.426037 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-78628cc1-4b4f-49c1-90af-c3bf07a15a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:49.436039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:49.488610 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1286/2587] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:49.496371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbe53f-faf0-4bee-95cb-721de7526045 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:49.496658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbe53f-faf0-4bee-95cb-721de7526045 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:49.496930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbe53f-faf0-4bee-95cb-721de7526045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:49.517865 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e1dbe53f-faf0-4bee-95cb-721de7526045 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:49.519065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e1dbe53f-faf0-4bee-95cb-721de7526045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:49.527049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1302/2588] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:49.532017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628cc1-4b4f-49c1-90af-c3bf07a15a68 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:49.541974 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628cc1-4b4f-49c1-90af-c3bf07a15a68 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:49.546993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce1012-e39b-4bb0-a4f2-38ee56620b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:49.547745 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce1012-e39b-4bb0-a4f2-38ee56620b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:49.548405 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce1012-e39b-4bb0-a4f2-38ee56620b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:49.548678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce1012-e39b-4bb0-a4f2-38ee56620b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:49.549416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce1012-e39b-4bb0-a4f2-38ee56620b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:44:49.549721 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce1012-e39b-4bb0-a4f2-38ee56620b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:49.551327 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce1012-e39b-4bb0-a4f2-38ee56620b43 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:49.563188 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1287/2589] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:44:49.567946 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbe53f-faf0-4bee-95cb-721de7526045 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:49.578737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbe53f-faf0-4bee-95cb-721de7526045 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:49.583431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6aa61-f551-4e91-8159-c8e719a3b07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:49.584039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6aa61-f551-4e91-8159-c8e719a3b07c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:49.584314 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6aa61-f551-4e91-8159-c8e719a3b07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:49.584582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6aa61-f551-4e91-8159-c8e719a3b07c admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:49.585274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6aa61-f551-4e91-8159-c8e719a3b07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:49.587154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6aa61-f551-4e91-8159-c8e719a3b07c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:49.676276 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:49.682771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1303/2590] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:49 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:49.687574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce1012-e39b-4bb0-a4f2-38ee56620b43 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:49.697706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce1012-e39b-4bb0-a4f2-38ee56620b43 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:49.755876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b2710-3f25-4970-9998-fcaad62c8bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:49.756495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2710-3f25-4970-9998-fcaad62c8bae admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:49.756781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2710-3f25-4970-9998-fcaad62c8bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:49.757048 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2710-3f25-4970-9998-fcaad62c8bae admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:49.757749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b2710-3f25-4970-9998-fcaad62c8bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:49.759661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b2710-3f25-4970-9998-fcaad62c8bae admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:49.876231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1288/2591] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:49 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:49.880455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6aa61-f551-4e91-8159-c8e719a3b07c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:49.890844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6aa61-f551-4e91-8159-c8e719a3b07c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:49.895371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee2365-5d72-4a48-b1e9-5d832bc3c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:49.895995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee2365-5d72-4a48-b1e9-5d832bc3c9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:49.896272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee2365-5d72-4a48-b1e9-5d832bc3c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:49.896541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee2365-5d72-4a48-b1e9-5d832bc3c9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:49.897267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee2365-5d72-4a48-b1e9-5d832bc3c9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:49.898852 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee2365-5d72-4a48-b1e9-5d832bc3c9fb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:49.909686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1304/2592] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:49.914278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b2710-3f25-4970-9998-fcaad62c8bae admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:49.925452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b2710-3f25-4970-9998-fcaad62c8bae admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:49.932027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883379ba-24af-4719-898f-aa1fa3c91f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:49.932027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883379ba-24af-4719-898f-aa1fa3c91f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:49.932027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883379ba-24af-4719-898f-aa1fa3c91f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:49.932451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883379ba-24af-4719-898f-aa1fa3c91f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:49.933015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883379ba-24af-4719-898f-aa1fa3c91f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:49.934665 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883379ba-24af-4719-898f-aa1fa3c91f30 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:49.946064 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1289/2593] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:49.950494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee2365-5d72-4a48-b1e9-5d832bc3c9fb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:49.960830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee2365-5d72-4a48-b1e9-5d832bc3c9fb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:49.965476 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7d7a0-dd7a-4ffd-a3a3-cdc831e8a135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:49.966139 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7d7a0-dd7a-4ffd-a3a3-cdc831e8a135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:49.966416 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7d7a0-dd7a-4ffd-a3a3-cdc831e8a135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:49.966688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7d7a0-dd7a-4ffd-a3a3-cdc831e8a135 admin admin] PATH_INFO: `/v3/projects/08cbb8965fa54db9868f648ee5039430/users/a7926da82c9b4df2a525bdfbacb7f098/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:49.982429 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7d7a0-dd7a-4ffd-a3a3-cdc831e8a135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08cbb8965fa54db9868f648ee5039430, user_id=a7926da82c9b4df2a525bdfbacb7f098, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:49.985753 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7d7a0-dd7a-4ffd-a3a3-cdc831e8a135 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:50.127094 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1305/2594] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:49 2022] PUT /identity/v3/projects/08cbb8965fa54db9868f648ee5039430/users/a7926da82c9b4df2a525bdfbacb7f098/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:44:50.137629 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26161f3-b94a-4f06-ad1b-6d1089ce8e20 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:50.137916 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26161f3-b94a-4f06-ad1b-6d1089ce8e20 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:50.138195 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26161f3-b94a-4f06-ad1b-6d1089ce8e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:50.169301 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c26161f3-b94a-4f06-ad1b-6d1089ce8e20 None None] MFA Rules not processed for user `a7926da82c9b4df2a525bdfbacb7f098`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:50.170563 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c26161f3-b94a-4f06-ad1b-6d1089ce8e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:50.235278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1290/2595] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:50.239833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7d7a0-dd7a-4ffd-a3a3-cdc831e8a135 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:50.302852 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7d7a0-dd7a-4ffd-a3a3-cdc831e8a135 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:50.307543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186b06f-d59d-416e-bd1f-541341ba919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:50.308162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b06f-d59d-416e-bd1f-541341ba919b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:50.308443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b06f-d59d-416e-bd1f-541341ba919b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:50.308752 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b06f-d59d-416e-bd1f-541341ba919b admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:50.309464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186b06f-d59d-416e-bd1f-541341ba919b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:50.311357 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186b06f-d59d-416e-bd1f-541341ba919b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:50.397652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1306/2596] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:50 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:50.401744 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26161f3-b94a-4f06-ad1b-6d1089ce8e20 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:50.413880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26161f3-b94a-4f06-ad1b-6d1089ce8e20 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:50.422397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:50.474740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c793dd-5f3d-4474-a72f-891d613085f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:50.475372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c793dd-5f3d-4474-a72f-891d613085f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:50.475794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c793dd-5f3d-4474-a72f-891d613085f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:50.476276 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c793dd-5f3d-4474-a72f-891d613085f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:50.477352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c793dd-5f3d-4474-a72f-891d613085f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:50.479688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c793dd-5f3d-4474-a72f-891d613085f5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:50.559481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1291/2597] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:50 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:44:50.564136 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186b06f-d59d-416e-bd1f-541341ba919b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:50.574760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186b06f-d59d-416e-bd1f-541341ba919b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:50.580229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c795d-54d5-477d-8346-525e86afc372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:50.580875 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c795d-54d5-477d-8346-525e86afc372 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:50.581171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c795d-54d5-477d-8346-525e86afc372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:50.581445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c795d-54d5-477d-8346-525e86afc372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:50.582141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c795d-54d5-477d-8346-525e86afc372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:50.583731 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c795d-54d5-477d-8346-525e86afc372 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:50.595513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1307/2598] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:50.600442 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c793dd-5f3d-4474-a72f-891d613085f5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:50.611521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c793dd-5f3d-4474-a72f-891d613085f5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:50.616204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401b5db-5548-468f-84f5-eeacc31f1669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:50.616861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b5db-5548-468f-84f5-eeacc31f1669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:50.617163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b5db-5548-468f-84f5-eeacc31f1669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:50.617487 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b5db-5548-468f-84f5-eeacc31f1669 admin admin] PATH_INFO: `/v3/projects/e3fdd81979ee43b7879b5f74b24518fe/users/5617e5980b5c4e93b3b14d9d1148f8e2/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:50.635530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401b5db-5548-468f-84f5-eeacc31f1669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3fdd81979ee43b7879b5f74b24518fe, user_id=5617e5980b5c4e93b3b14d9d1148f8e2, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:50.638231 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401b5db-5548-468f-84f5-eeacc31f1669 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:50.715452 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1292/2599] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:50 2022] PUT /identity/v3/projects/e3fdd81979ee43b7879b5f74b24518fe/users/5617e5980b5c4e93b3b14d9d1148f8e2/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:50.720043 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c795d-54d5-477d-8346-525e86afc372 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:50.730463 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c795d-54d5-477d-8346-525e86afc372 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:50.786493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee888c7-7dce-4f21-b035-8138b694e04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:50.787382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee888c7-7dce-4f21-b035-8138b694e04a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:50.787657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee888c7-7dce-4f21-b035-8138b694e04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:50.787924 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee888c7-7dce-4f21-b035-8138b694e04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:50.788609 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee888c7-7dce-4f21-b035-8138b694e04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:50.790234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee888c7-7dce-4f21-b035-8138b694e04a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:50.800197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1308/2600] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:50.804431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401b5db-5548-468f-84f5-eeacc31f1669 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:50.816887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401b5db-5548-468f-84f5-eeacc31f1669 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:50.821486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992122c-2bef-43a1-963e-a6dce696d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:50.822151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992122c-2bef-43a1-963e-a6dce696d9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:50.822432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992122c-2bef-43a1-963e-a6dce696d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:50.822706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992122c-2bef-43a1-963e-a6dce696d9ea admin admin] PATH_INFO: `/v3/projects/e3fdd81979ee43b7879b5f74b24518fe/users/5617e5980b5c4e93b3b14d9d1148f8e2/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:50.824672 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992122c-2bef-43a1-963e-a6dce696d9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3fdd81979ee43b7879b5f74b24518fe, user_id=5617e5980b5c4e93b3b14d9d1148f8e2, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:50.827360 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992122c-2bef-43a1-963e-a6dce696d9ea admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:50.839293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1293/2601] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:50 2022] PUT /identity/v3/projects/e3fdd81979ee43b7879b5f74b24518fe/users/5617e5980b5c4e93b3b14d9d1148f8e2/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:50.851143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47d24b-9d07-4a36-b409-6850a63a2090 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:50.851589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47d24b-9d07-4a36-b409-6850a63a2090 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:50.851869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47d24b-9d07-4a36-b409-6850a63a2090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:50.882034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fc47d24b-9d07-4a36-b409-6850a63a2090 None None] MFA Rules not processed for user `5617e5980b5c4e93b3b14d9d1148f8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:50.883242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fc47d24b-9d07-4a36-b409-6850a63a2090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:50.908707 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:50.956656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1309/2602] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:50.967831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992122c-2bef-43a1-963e-a6dce696d9ea admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:50.969608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1992122c-2bef-43a1-963e-a6dce696d9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:51.029527 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992122c-2bef-43a1-963e-a6dce696d9ea admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:51.034087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf00fa-67b3-46b1-af28-de51832253e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:51.034711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf00fa-67b3-46b1-af28-de51832253e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:51.034987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf00fa-67b3-46b1-af28-de51832253e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:51.035256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf00fa-67b3-46b1-af28-de51832253e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:51.045253 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf00fa-67b3-46b1-af28-de51832253e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:51.047190 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf00fa-67b3-46b1-af28-de51832253e2 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:51.056655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1294/2603] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:52.139915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47d24b-9d07-4a36-b409-6850a63a2090 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:52.205779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47d24b-9d07-4a36-b409-6850a63a2090 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:52.210301 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:52.211032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:52.211335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:52.211623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] PATH_INFO: `/v3/users/a7926da82c9b4df2a525bdfbacb7f098` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:52.212776 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7926da82c9b4df2a525bdfbacb7f098)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:52.214750 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:52.420405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7926da82c9b4df2a525bdfbacb7f098'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:52.421251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7926da82c9b4df2a525bdfbacb7f098'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:52.492124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7926da82c9b4df2a525bdfbacb7f098'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:52.492743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7926da82c9b4df2a525bdfbacb7f098'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:52.506418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7926da82c9b4df2a525bdfbacb7f098'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:52.518820 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1310/2604] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:52 2022] DELETE /identity/v3/users/a7926da82c9b4df2a525bdfbacb7f098 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:52.523478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebd5df-a4ab-442e-9fb4-5c9dce9f7ff0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:52.524951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebd5df-a4ab-442e-9fb4-5c9dce9f7ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:52.524951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebd5df-a4ab-442e-9fb4-5c9dce9f7ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:52.543995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6aebd5df-a4ab-442e-9fb4-5c9dce9f7ff0 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:52.545236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6aebd5df-a4ab-442e-9fb4-5c9dce9f7ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:52.606220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1295/2605] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:52.619487 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:52.620913 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:52.668213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:52.683289 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f6a66-294f-4300-adef-3ca132c3ed3f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:52.686859 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0371825-c7a2-4d03-abfb-e1fbebcfcba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:52.687479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371825-c7a2-4d03-abfb-e1fbebcfcba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:52.687760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371825-c7a2-4d03-abfb-e1fbebcfcba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:52.688036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0371825-c7a2-4d03-abfb-e1fbebcfcba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:52.697710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0371825-c7a2-4d03-abfb-e1fbebcfcba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:52.699138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0371825-c7a2-4d03-abfb-e1fbebcfcba4 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:52.709235 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1311/2606] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:53.105362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebd5df-a4ab-442e-9fb4-5c9dce9f7ff0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:53.106780 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6aebd5df-a4ab-442e-9fb4-5c9dce9f7ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:53.119370 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebd5df-a4ab-442e-9fb4-5c9dce9f7ff0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:53.124703 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:53.125489 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:53.130364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:53.130364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] PATH_INFO: `/v3/projects/08cbb8965fa54db9868f648ee5039430` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:53.130364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=08cbb8965fa54db9868f648ee5039430)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:53.130882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:53.132601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:53.276831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08cbb8965fa54db9868f648ee5039430', 'request_id': 'req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:53.283450 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08cbb8965fa54db9868f648ee5039430', 'request_id': 'req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:53.289294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08cbb8965fa54db9868f648ee5039430', 'request_id': 'req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:53.361245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] The token cache is being invalidate because project 08cbb8965fa54db9868f648ee5039430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:53.361592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:53.362211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:53.363751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1296/2607] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:53 2022] DELETE /identity/v3/projects/08cbb8965fa54db9868f648ee5039430 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:53.367864 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0371825-c7a2-4d03-abfb-e1fbebcfcba4 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:53.379424 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0371825-c7a2-4d03-abfb-e1fbebcfcba4 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:53.441316 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b58aa-f47f-4dbd-b0d8-e8c3248b9579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:53.441962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b58aa-f47f-4dbd-b0d8-e8c3248b9579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:53.442242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b58aa-f47f-4dbd-b0d8-e8c3248b9579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:53.442519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b58aa-f47f-4dbd-b0d8-e8c3248b9579 admin admin] PATH_INFO: `/v3/users/5617e5980b5c4e93b3b14d9d1148f8e2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:53.443681 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b58aa-f47f-4dbd-b0d8-e8c3248b9579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5617e5980b5c4e93b3b14d9d1148f8e2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:53.445647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b58aa-f47f-4dbd-b0d8-e8c3248b9579 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:53.634831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a6b58aa-f47f-4dbd-b0d8-e8c3248b9579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5617e5980b5c4e93b3b14d9d1148f8e2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:53.635506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a6b58aa-f47f-4dbd-b0d8-e8c3248b9579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5617e5980b5c4e93b3b14d9d1148f8e2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:53.709001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a6b58aa-f47f-4dbd-b0d8-e8c3248b9579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5617e5980b5c4e93b3b14d9d1148f8e2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:53.709660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a6b58aa-f47f-4dbd-b0d8-e8c3248b9579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5617e5980b5c4e93b3b14d9d1148f8e2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:53.724708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a6b58aa-f47f-4dbd-b0d8-e8c3248b9579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5617e5980b5c4e93b3b14d9d1148f8e2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:53.737458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1312/2608] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:53 2022] DELETE /identity/v3/users/5617e5980b5c4e93b3b14d9d1148f8e2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:54.134146 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:54.135800 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:54.149953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905b3a0-d593-4dba-b2f5-1a19c14ea9ee admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:54.217237 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:54.217931 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:54.218238 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:54.218514 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] PATH_INFO: `/v3/projects/e3fdd81979ee43b7879b5f74b24518fe` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:54.219893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3fdd81979ee43b7879b5f74b24518fe)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:54.221746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:54.316652 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3fdd81979ee43b7879b5f74b24518fe', 'request_id': 'req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:54.322961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3fdd81979ee43b7879b5f74b24518fe', 'request_id': 'req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:54.328362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3fdd81979ee43b7879b5f74b24518fe', 'request_id': 'req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:54.383832 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] The token cache is being invalidate because project e3fdd81979ee43b7879b5f74b24518fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:54.384115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:54.384724 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9975f0b5-ebdd-443e-93b6-0b7e7c8130f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:54.386260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1297/2609] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:54 2022] DELETE /identity/v3/projects/e3fdd81979ee43b7879b5f74b24518fe => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:54.391394 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d57c-42b2-4b1c-aa45-6e1fbed7ed29 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:54.391921 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d57c-42b2-4b1c-aa45-6e1fbed7ed29 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:54.392060 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d57c-42b2-4b1c-aa45-6e1fbed7ed29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:54.412902 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ea92d57c-42b2-4b1c-aa45-6e1fbed7ed29 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:54.414241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ea92d57c-42b2-4b1c-aa45-6e1fbed7ed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:54.475938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1313/2610] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:54.483903 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebaea-e3fd-481b-9483-49ab973a2f22 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:54.484303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebaea-e3fd-481b-9483-49ab973a2f22 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:54.484578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebaea-e3fd-481b-9483-49ab973a2f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:54.506236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1f2ebaea-e3fd-481b-9483-49ab973a2f22 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:54.507464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f2ebaea-e3fd-481b-9483-49ab973a2f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:54.515395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1298/2611] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:54.520303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d57c-42b2-4b1c-aa45-6e1fbed7ed29 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:54.525104 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:54.531134 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d57c-42b2-4b1c-aa45-6e1fbed7ed29 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:54.537683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829c022-2d08-4a0f-a2fe-2d8cf8650078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:54.541761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829c022-2d08-4a0f-a2fe-2d8cf8650078 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:54.541761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829c022-2d08-4a0f-a2fe-2d8cf8650078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:54.541761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829c022-2d08-4a0f-a2fe-2d8cf8650078 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:54.541761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829c022-2d08-4a0f-a2fe-2d8cf8650078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:44:54.541761 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829c022-2d08-4a0f-a2fe-2d8cf8650078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:54.542284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829c022-2d08-4a0f-a2fe-2d8cf8650078 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:54.557415 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1314/2612] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:44:54.559616 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ebaea-e3fd-481b-9483-49ab973a2f22 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:54.570176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ebaea-e3fd-481b-9483-49ab973a2f22 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:54.574974 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a672a8b-58b5-41cf-8cea-f1e58300c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:54.576046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a672a8b-58b5-41cf-8cea-f1e58300c6ae admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:54.576046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a672a8b-58b5-41cf-8cea-f1e58300c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:54.576265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a672a8b-58b5-41cf-8cea-f1e58300c6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:54.576887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a672a8b-58b5-41cf-8cea-f1e58300c6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:54.578854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a672a8b-58b5-41cf-8cea-f1e58300c6ae admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:54.593519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:54.716746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1299/2613] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:54 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:54.721016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829c022-2d08-4a0f-a2fe-2d8cf8650078 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:54.731466 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829c022-2d08-4a0f-a2fe-2d8cf8650078 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:54.800659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be133d5-1dd0-4fd1-86f1-55435f3eedca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:54.801321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be133d5-1dd0-4fd1-86f1-55435f3eedca admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:54.801736 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be133d5-1dd0-4fd1-86f1-55435f3eedca admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:54.801953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be133d5-1dd0-4fd1-86f1-55435f3eedca admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:54.802649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be133d5-1dd0-4fd1-86f1-55435f3eedca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:54.804644 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be133d5-1dd0-4fd1-86f1-55435f3eedca admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:54.865538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1315/2614] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:54 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:54.869490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a672a8b-58b5-41cf-8cea-f1e58300c6ae admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:54.880428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a672a8b-58b5-41cf-8cea-f1e58300c6ae admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:54.885790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354fbfd-922a-4b1e-9daf-0ae6483dee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:54.887727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fbfd-922a-4b1e-9daf-0ae6483dee5f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:54.887727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fbfd-922a-4b1e-9daf-0ae6483dee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:54.887727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fbfd-922a-4b1e-9daf-0ae6483dee5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:54.887727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354fbfd-922a-4b1e-9daf-0ae6483dee5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:54.889507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354fbfd-922a-4b1e-9daf-0ae6483dee5f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:54.900065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1300/2615] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:54.904094 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be133d5-1dd0-4fd1-86f1-55435f3eedca admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:54.916121 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be133d5-1dd0-4fd1-86f1-55435f3eedca admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:54.920931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a53c7b-9078-48e8-bac3-bd55c2c227fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:54.921577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53c7b-9078-48e8-bac3-bd55c2c227fc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:54.921857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53c7b-9078-48e8-bac3-bd55c2c227fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:54.922228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53c7b-9078-48e8-bac3-bd55c2c227fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:54.923574 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a53c7b-9078-48e8-bac3-bd55c2c227fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:54.925178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a53c7b-9078-48e8-bac3-bd55c2c227fc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:54.935601 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1316/2616] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:54.941904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354fbfd-922a-4b1e-9daf-0ae6483dee5f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:54.952017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354fbfd-922a-4b1e-9daf-0ae6483dee5f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:54.957499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b3f25-0401-4f90-8778-95d307d7b9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:54.958155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3f25-0401-4f90-8778-95d307d7b9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:54.958467 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3f25-0401-4f90-8778-95d307d7b9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:54.958742 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3f25-0401-4f90-8778-95d307d7b9d5 admin admin] PATH_INFO: `/v3/projects/196d66b84336404cbf6f2098f1cfd842/users/c0cd7e5982bb487082bde3412e49767c/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:54.975245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b3f25-0401-4f90-8778-95d307d7b9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196d66b84336404cbf6f2098f1cfd842, user_id=c0cd7e5982bb487082bde3412e49767c, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:54.978245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b3f25-0401-4f90-8778-95d307d7b9d5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:55.079761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1301/2617] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:54 2022] PUT /identity/v3/projects/196d66b84336404cbf6f2098f1cfd842/users/c0cd7e5982bb487082bde3412e49767c/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:55.090585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9c532-8fc3-45f1-a964-da010a2b187d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:55.091102 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9c532-8fc3-45f1-a964-da010a2b187d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:55.091375 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9c532-8fc3-45f1-a964-da010a2b187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:55.120458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3fe9c532-8fc3-45f1-a964-da010a2b187d None None] MFA Rules not processed for user `c0cd7e5982bb487082bde3412e49767c`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:55.121701 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3fe9c532-8fc3-45f1-a964-da010a2b187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:55.199005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1317/2618] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:55.203601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b3f25-0401-4f90-8778-95d307d7b9d5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:55.273236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b3f25-0401-4f90-8778-95d307d7b9d5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:55.278018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c6419-8884-4653-9093-6f828ac5ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:55.278633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6419-8884-4653-9093-6f828ac5ef3b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:55.278913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6419-8884-4653-9093-6f828ac5ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:55.279185 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c6419-8884-4653-9093-6f828ac5ef3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:55.279862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c6419-8884-4653-9093-6f828ac5ef3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:55.281827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c6419-8884-4653-9093-6f828ac5ef3b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:55.383794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1302/2619] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:55 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:55.388006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9c532-8fc3-45f1-a964-da010a2b187d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:55.399432 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9c532-8fc3-45f1-a964-da010a2b187d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:55.463648 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:55.470581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd32aa-dd99-4a61-af96-df8b3c347671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:55.471304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd32aa-dd99-4a61-af96-df8b3c347671 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:55.471622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd32aa-dd99-4a61-af96-df8b3c347671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:55.472037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd32aa-dd99-4a61-af96-df8b3c347671 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:55.472740 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd32aa-dd99-4a61-af96-df8b3c347671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:55.474720 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd32aa-dd99-4a61-af96-df8b3c347671 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:55.607206 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1318/2620] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:55 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:55.611743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c6419-8884-4653-9093-6f828ac5ef3b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:55.622270 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c6419-8884-4653-9093-6f828ac5ef3b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:55.627637 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92996e-2216-4eff-957e-b9a627a2c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:55.628423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92996e-2216-4eff-957e-b9a627a2c94d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:55.628709 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92996e-2216-4eff-957e-b9a627a2c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:55.628986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92996e-2216-4eff-957e-b9a627a2c94d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:55.630018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92996e-2216-4eff-957e-b9a627a2c94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:55.631660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92996e-2216-4eff-957e-b9a627a2c94d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:55.643718 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1303/2621] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:55.647916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd32aa-dd99-4a61-af96-df8b3c347671 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:55.658682 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd32aa-dd99-4a61-af96-df8b3c347671 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:55.663708 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17ecdc-f55c-45bf-9754-aaed7980652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:55.664410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17ecdc-f55c-45bf-9754-aaed7980652f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:55.664690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17ecdc-f55c-45bf-9754-aaed7980652f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:55.664963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17ecdc-f55c-45bf-9754-aaed7980652f admin admin] PATH_INFO: `/v3/projects/468faad34a5142bb99e5bb4e5ed8faa4/users/45de351866164418b62f35070c90c6c4/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:55.680286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17ecdc-f55c-45bf-9754-aaed7980652f admin admin] RBAC: Authorizing `identity:create_grant(project_id=468faad34a5142bb99e5bb4e5ed8faa4, user_id=45de351866164418b62f35070c90c6c4, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:55.682972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17ecdc-f55c-45bf-9754-aaed7980652f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:55.773823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1319/2622] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:55 2022] PUT /identity/v3/projects/468faad34a5142bb99e5bb4e5ed8faa4/users/45de351866164418b62f35070c90c6c4/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:55.781840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92996e-2216-4eff-957e-b9a627a2c94d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:55.793286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92996e-2216-4eff-957e-b9a627a2c94d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:55.850148 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff466475-c2dd-47bc-b6b1-c897d584dc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:55.850885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff466475-c2dd-47bc-b6b1-c897d584dc09 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:55.851141 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff466475-c2dd-47bc-b6b1-c897d584dc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:55.851481 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff466475-c2dd-47bc-b6b1-c897d584dc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:55.852181 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff466475-c2dd-47bc-b6b1-c897d584dc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:55.853831 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff466475-c2dd-47bc-b6b1-c897d584dc09 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:55.865594 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1304/2623] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:55.869751 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17ecdc-f55c-45bf-9754-aaed7980652f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:55.883770 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17ecdc-f55c-45bf-9754-aaed7980652f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:55.888624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7510f3e-e47e-456f-9ac7-f64a607e9a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:55.889327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7510f3e-e47e-456f-9ac7-f64a607e9a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:55.889606 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7510f3e-e47e-456f-9ac7-f64a607e9a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:55.889876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7510f3e-e47e-456f-9ac7-f64a607e9a0c admin admin] PATH_INFO: `/v3/projects/468faad34a5142bb99e5bb4e5ed8faa4/users/45de351866164418b62f35070c90c6c4/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:55.892049 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7510f3e-e47e-456f-9ac7-f64a607e9a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=468faad34a5142bb99e5bb4e5ed8faa4, user_id=45de351866164418b62f35070c90c6c4, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:55.894700 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7510f3e-e47e-456f-9ac7-f64a607e9a0c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:55.905177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1320/2624] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:55 2022] PUT /identity/v3/projects/468faad34a5142bb99e5bb4e5ed8faa4/users/45de351866164418b62f35070c90c6c4/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:55.917215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd1e4-2d9d-4910-bc38-b682b4b7546e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:55.917506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd1e4-2d9d-4910-bc38-b682b4b7546e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:55.917786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fd1e4-2d9d-4910-bc38-b682b4b7546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:55.952044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5a7fd1e4-2d9d-4910-bc38-b682b4b7546e None None] MFA Rules not processed for user `45de351866164418b62f35070c90c6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:55.953371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5a7fd1e4-2d9d-4910-bc38-b682b4b7546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:55.970958 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:56.036147 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1305/2625] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:56.048116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7510f3e-e47e-456f-9ac7-f64a607e9a0c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:56.049849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f7510f3e-e47e-456f-9ac7-f64a607e9a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:56.111525 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7510f3e-e47e-456f-9ac7-f64a607e9a0c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:56.115461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4e7ed-e9dd-4f00-a00d-39485c609bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:56.116075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4e7ed-e9dd-4f00-a00d-39485c609bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:56.116406 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4e7ed-e9dd-4f00-a00d-39485c609bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:56.116679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4e7ed-e9dd-4f00-a00d-39485c609bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:56.131068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4e7ed-e9dd-4f00-a00d-39485c609bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:56.132634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4e7ed-e9dd-4f00-a00d-39485c609bc9 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:56.144683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1321/2626] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:44:56.690118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fd1e4-2d9d-4910-bc38-b682b4b7546e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:56.758232 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fd1e4-2d9d-4910-bc38-b682b4b7546e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:56.763065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:56.763730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:56.764014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:56.764292 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] PATH_INFO: `/v3/users/c0cd7e5982bb487082bde3412e49767c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:56.765495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0cd7e5982bb487082bde3412e49767c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:56.767543 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:56.935675 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0cd7e5982bb487082bde3412e49767c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:56.983596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0cd7e5982bb487082bde3412e49767c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:56.984261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0cd7e5982bb487082bde3412e49767c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:56.984898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0cd7e5982bb487082bde3412e49767c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:56.997968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0cd7e5982bb487082bde3412e49767c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:57.010325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1306/2627] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:56 2022] DELETE /identity/v3/users/c0cd7e5982bb487082bde3412e49767c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:57.014866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236e54-808c-4090-a1d5-9d926723e9e2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:57.015371 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236e54-808c-4090-a1d5-9d926723e9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:57.015470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236e54-808c-4090-a1d5-9d926723e9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:57.035431 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5b236e54-808c-4090-a1d5-9d926723e9e2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:57.036630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5b236e54-808c-4090-a1d5-9d926723e9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:57.096162 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1322/2628] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:57.106350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:57.107781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:57.143869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:57.168350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8c3ea-ccd4-4ea8-88cb-29798c431f05 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:57.172222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e666b-9bc8-4a2c-9cb3-412f28bbfef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:57.172882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e666b-9bc8-4a2c-9cb3-412f28bbfef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:57.173162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e666b-9bc8-4a2c-9cb3-412f28bbfef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:57.173443 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e666b-9bc8-4a2c-9cb3-412f28bbfef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:57.182835 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e666b-9bc8-4a2c-9cb3-412f28bbfef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:57.184965 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e666b-9bc8-4a2c-9cb3-412f28bbfef5 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:57.196095 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1307/2629] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:44:57.642614 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236e54-808c-4090-a1d5-9d926723e9e2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:57.644202 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5b236e54-808c-4090-a1d5-9d926723e9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:57.657844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236e54-808c-4090-a1d5-9d926723e9e2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:57.663871 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:57.664564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:57.664915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:57.665312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] PATH_INFO: `/v3/projects/196d66b84336404cbf6f2098f1cfd842` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:57.669772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=196d66b84336404cbf6f2098f1cfd842)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:57.669772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:57.805652 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:57.807071 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196d66b84336404cbf6f2098f1cfd842', 'request_id': 'req-ce3bf289-c9c7-4138-98de-d256081a9231'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:57.813176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196d66b84336404cbf6f2098f1cfd842', 'request_id': 'req-ce3bf289-c9c7-4138-98de-d256081a9231'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:57.818642 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196d66b84336404cbf6f2098f1cfd842', 'request_id': 'req-ce3bf289-c9c7-4138-98de-d256081a9231'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:57.895805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] The token cache is being invalidate because project 196d66b84336404cbf6f2098f1cfd842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:57.896033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:57.896659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:57.898205 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1323/2630] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:57 2022] DELETE /identity/v3/projects/196d66b84336404cbf6f2098f1cfd842 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:57.902263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e666b-9bc8-4a2c-9cb3-412f28bbfef5 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:57.912681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e666b-9bc8-4a2c-9cb3-412f28bbfef5 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:57.969767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e17f2-25c3-4b33-b888-2649217d5e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:57.970410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e17f2-25c3-4b33-b888-2649217d5e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:57.970692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e17f2-25c3-4b33-b888-2649217d5e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:57.970964 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e17f2-25c3-4b33-b888-2649217d5e2c admin admin] PATH_INFO: `/v3/users/45de351866164418b62f35070c90c6c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:57.972122 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e17f2-25c3-4b33-b888-2649217d5e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45de351866164418b62f35070c90c6c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:57.974081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e17f2-25c3-4b33-b888-2649217d5e2c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:58.198542 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dd5e17f2-25c3-4b33-b888-2649217d5e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45de351866164418b62f35070c90c6c4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:58.263001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dd5e17f2-25c3-4b33-b888-2649217d5e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45de351866164418b62f35070c90c6c4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:58.263641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dd5e17f2-25c3-4b33-b888-2649217d5e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45de351866164418b62f35070c90c6c4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:58.264256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dd5e17f2-25c3-4b33-b888-2649217d5e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45de351866164418b62f35070c90c6c4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:58.277153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dd5e17f2-25c3-4b33-b888-2649217d5e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45de351866164418b62f35070c90c6c4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:58.291657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1308/2631] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:44:57 2022] DELETE /identity/v3/users/45de351866164418b62f35070c90c6c4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:58.726459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:58.727868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:58.744335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bf289-c9c7-4138-98de-d256081a9231 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:58.803131 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:58.803796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:58.804076 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:58.804347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] PATH_INFO: `/v3/projects/468faad34a5142bb99e5bb4e5ed8faa4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:58.805546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468faad34a5142bb99e5bb4e5ed8faa4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:58.807560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:58.932673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468faad34a5142bb99e5bb4e5ed8faa4', 'request_id': 'req-c876d645-9e04-4130-945d-ba64cb462756'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:58.939570 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468faad34a5142bb99e5bb4e5ed8faa4', 'request_id': 'req-c876d645-9e04-4130-945d-ba64cb462756'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:58.944911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468faad34a5142bb99e5bb4e5ed8faa4', 'request_id': 'req-c876d645-9e04-4130-945d-ba64cb462756'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:59.011217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] The token cache is being invalidate because project 468faad34a5142bb99e5bb4e5ed8faa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:44:59.011421 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:59.012095 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c876d645-9e04-4130-945d-ba64cb462756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:44:59.013683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1324/2632] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:44:58 2022] DELETE /identity/v3/projects/468faad34a5142bb99e5bb4e5ed8faa4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:59.019216 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb020-e928-4a9e-8e49-2987e6fed5d6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:59.019720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb020-e928-4a9e-8e49-2987e6fed5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:59.019887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb020-e928-4a9e-8e49-2987e6fed5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:59.040086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4dbfb020-e928-4a9e-8e49-2987e6fed5d6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:59.041321 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4dbfb020-e928-4a9e-8e49-2987e6fed5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:59.089229 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:59.101389 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1309/2633] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:59.108931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c803d-a18b-4c2d-b8c8-87d8fe51cacf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:59.109259 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c803d-a18b-4c2d-b8c8-87d8fe51cacf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:59.109538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c803d-a18b-4c2d-b8c8-87d8fe51cacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:59.131404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a08c803d-a18b-4c2d-b8c8-87d8fe51cacf None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:59.132629 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a08c803d-a18b-4c2d-b8c8-87d8fe51cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:59.140698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1325/2634] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:59.150782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb020-e928-4a9e-8e49-2987e6fed5d6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:59.162464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb020-e928-4a9e-8e49-2987e6fed5d6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:59.168530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50dceb-8f2d-4fbf-9ef9-110de56a1ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:59.169169 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50dceb-8f2d-4fbf-9ef9-110de56a1ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:59.169451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50dceb-8f2d-4fbf-9ef9-110de56a1ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:59.170232 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50dceb-8f2d-4fbf-9ef9-110de56a1ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:59.170579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50dceb-8f2d-4fbf-9ef9-110de56a1ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:44:59.170912 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50dceb-8f2d-4fbf-9ef9-110de56a1ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:59.173089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50dceb-8f2d-4fbf-9ef9-110de56a1ed6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:59.187024 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1310/2635] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:44:59.192234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c803d-a18b-4c2d-b8c8-87d8fe51cacf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:59.208329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c803d-a18b-4c2d-b8c8-87d8fe51cacf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:59.221970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4505b0e-1ec6-44e8-97bb-c4c0aa1d57f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:59.222600 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505b0e-1ec6-44e8-97bb-c4c0aa1d57f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:59.222880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505b0e-1ec6-44e8-97bb-c4c0aa1d57f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:59.223148 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4505b0e-1ec6-44e8-97bb-c4c0aa1d57f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:59.223822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4505b0e-1ec6-44e8-97bb-c4c0aa1d57f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:59.225959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4505b0e-1ec6-44e8-97bb-c4c0aa1d57f2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:59.321300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1326/2636] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:44:59 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:59.325945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50dceb-8f2d-4fbf-9ef9-110de56a1ed6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:59.338929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50dceb-8f2d-4fbf-9ef9-110de56a1ed6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:59.418257 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d16925-3804-4052-8f71-7246f4b1202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:59.418914 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16925-3804-4052-8f71-7246f4b1202c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:59.419197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16925-3804-4052-8f71-7246f4b1202c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:59.419471 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16925-3804-4052-8f71-7246f4b1202c admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:59.420210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d16925-3804-4052-8f71-7246f4b1202c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:59.422302 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d16925-3804-4052-8f71-7246f4b1202c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:59.487776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1311/2637] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:44:59 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:44:59.491901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4505b0e-1ec6-44e8-97bb-c4c0aa1d57f2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:59.502985 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4505b0e-1ec6-44e8-97bb-c4c0aa1d57f2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:59.507712 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c084f1-7ddb-43c4-b61f-679210729c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:59.508335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c084f1-7ddb-43c4-b61f-679210729c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:59.508662 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c084f1-7ddb-43c4-b61f-679210729c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:59.508939 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c084f1-7ddb-43c4-b61f-679210729c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:59.509807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c084f1-7ddb-43c4-b61f-679210729c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:59.511901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c084f1-7ddb-43c4-b61f-679210729c8b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:59.524229 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1327/2638] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:59.528505 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d16925-3804-4052-8f71-7246f4b1202c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:59.539532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d16925-3804-4052-8f71-7246f4b1202c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:59.544365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc58cc-654f-4e28-9b5b-e0d9fcd5cded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:59.544977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc58cc-654f-4e28-9b5b-e0d9fcd5cded admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:59.545296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc58cc-654f-4e28-9b5b-e0d9fcd5cded admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:59.545569 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc58cc-654f-4e28-9b5b-e0d9fcd5cded admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:59.546269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc58cc-654f-4e28-9b5b-e0d9fcd5cded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:59.548517 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc58cc-654f-4e28-9b5b-e0d9fcd5cded admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:59.559388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1312/2639] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:44:59.563542 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c084f1-7ddb-43c4-b61f-679210729c8b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:59.578097 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c084f1-7ddb-43c4-b61f-679210729c8b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:59.583107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc56e1-c19b-4f7e-a7cc-1fc344137d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:59.583771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc56e1-c19b-4f7e-a7cc-1fc344137d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:59.584185 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc56e1-c19b-4f7e-a7cc-1fc344137d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:59.584454 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc56e1-c19b-4f7e-a7cc-1fc344137d25 admin admin] PATH_INFO: `/v3/projects/9e3b79cfcd5a485b957787ecfd22159e/users/de895c1b657f41baaaa81bcb39b74c20/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:59.600349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc56e1-c19b-4f7e-a7cc-1fc344137d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3b79cfcd5a485b957787ecfd22159e, user_id=de895c1b657f41baaaa81bcb39b74c20, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:59.604042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc56e1-c19b-4f7e-a7cc-1fc344137d25 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:59.665468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1328/2640] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:44:59 2022] PUT /identity/v3/projects/9e3b79cfcd5a485b957787ecfd22159e/users/de895c1b657f41baaaa81bcb39b74c20/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:44:59.670783 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6fb7-692c-4af4-9731-ed75320edf8a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:59.671069 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6fb7-692c-4af4-9731-ed75320edf8a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:59.671342 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6fb7-692c-4af4-9731-ed75320edf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:59.695199 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e0ef6fb7-692c-4af4-9731-ed75320edf8a None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:44:59.696406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0ef6fb7-692c-4af4-9731-ed75320edf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:59.765394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1313/2641] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:44:59.775881 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc56e1-c19b-4f7e-a7cc-1fc344137d25 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:44:59.777995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c8bc56e1-c19b-4f7e-a7cc-1fc344137d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:44:59.785635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:44:59.849014 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc56e1-c19b-4f7e-a7cc-1fc344137d25 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:44:59.852911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00eb33-1ecd-4da6-8dea-825701b43e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:44:59.853577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00eb33-1ecd-4da6-8dea-825701b43e6f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:44:59.853861 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00eb33-1ecd-4da6-8dea-825701b43e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:44:59.854137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00eb33-1ecd-4da6-8dea-825701b43e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:44:59.869859 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00eb33-1ecd-4da6-8dea-825701b43e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:44:59.871327 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00eb33-1ecd-4da6-8dea-825701b43e6f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:44:59.882221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1329/2642] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:01.212684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a4215-d2e3-4154-b512-a2355f0cf30e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:01.213588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a4215-d2e3-4154-b512-a2355f0cf30e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:01.213588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a4215-d2e3-4154-b512-a2355f0cf30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:01.241644 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ba0a4215-d2e3-4154-b512-a2355f0cf30e None None] MFA Rules not processed for user `de895c1b657f41baaaa81bcb39b74c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:01.242850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ba0a4215-d2e3-4154-b512-a2355f0cf30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:01.293887 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:01.312642 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1314/2643] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:01.317996 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00eb33-1ecd-4da6-8dea-825701b43e6f service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:01.327477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00eb33-1ecd-4da6-8dea-825701b43e6f service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:01.332156 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38274ae9-bac2-49ff-b40b-d2d8ab221996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:01.332751 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38274ae9-bac2-49ff-b40b-d2d8ab221996 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:01.333026 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38274ae9-bac2-49ff-b40b-d2d8ab221996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:01.333319 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38274ae9-bac2-49ff-b40b-d2d8ab221996 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:01.333971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38274ae9-bac2-49ff-b40b-d2d8ab221996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:01.335938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38274ae9-bac2-49ff-b40b-d2d8ab221996 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:01.440549 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1330/2644] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:45:01 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:45:01.444681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a4215-d2e3-4154-b512-a2355f0cf30e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:01.455876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a4215-d2e3-4154-b512-a2355f0cf30e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:01.514218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335f31a-58ac-4d6f-9e3f-6135065a44a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:01.514845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335f31a-58ac-4d6f-9e3f-6135065a44a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:01.515123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335f31a-58ac-4d6f-9e3f-6135065a44a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:01.515403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335f31a-58ac-4d6f-9e3f-6135065a44a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:01.516079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335f31a-58ac-4d6f-9e3f-6135065a44a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:01.519069 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335f31a-58ac-4d6f-9e3f-6135065a44a2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:01.630243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1315/2645] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:45:01 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:45:01.634218 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38274ae9-bac2-49ff-b40b-d2d8ab221996 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:01.647380 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38274ae9-bac2-49ff-b40b-d2d8ab221996 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:01.652231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d037ff-408a-47af-934e-6acf7074efe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:01.652851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d037ff-408a-47af-934e-6acf7074efe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:01.653183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d037ff-408a-47af-934e-6acf7074efe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:01.653462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d037ff-408a-47af-934e-6acf7074efe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:01.654155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d037ff-408a-47af-934e-6acf7074efe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:01.655742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d037ff-408a-47af-934e-6acf7074efe7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:01.667473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1331/2646] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:45:01.671731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335f31a-58ac-4d6f-9e3f-6135065a44a2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:01.686263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335f31a-58ac-4d6f-9e3f-6135065a44a2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:01.691782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9218a-e2e1-4c90-9ae4-64c234ee75ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:01.692448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9218a-e2e1-4c90-9ae4-64c234ee75ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:01.692727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9218a-e2e1-4c90-9ae4-64c234ee75ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:01.693001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9218a-e2e1-4c90-9ae4-64c234ee75ba admin admin] PATH_INFO: `/v3/projects/46020c10a44642938198ca5cd5c379c0/users/86fa37b40b1f404da7de68604dc7a8ce/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:01.708434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9218a-e2e1-4c90-9ae4-64c234ee75ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=46020c10a44642938198ca5cd5c379c0, user_id=86fa37b40b1f404da7de68604dc7a8ce, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:01.711140 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9218a-e2e1-4c90-9ae4-64c234ee75ba admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:01.795374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1316/2647] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:45:01 2022] PUT /identity/v3/projects/46020c10a44642938198ca5cd5c379c0/users/86fa37b40b1f404da7de68604dc7a8ce/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:45:01.799528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d037ff-408a-47af-934e-6acf7074efe7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:01.809397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d037ff-408a-47af-934e-6acf7074efe7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:01.868243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8753e-ee1f-4da7-a215-945c52631354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:01.868870 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8753e-ee1f-4da7-a215-945c52631354 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:01.869208 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8753e-ee1f-4da7-a215-945c52631354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:01.869503 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8753e-ee1f-4da7-a215-945c52631354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:01.870198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8753e-ee1f-4da7-a215-945c52631354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:01.871849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8753e-ee1f-4da7-a215-945c52631354 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:01.883347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1332/2648] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:45:01.887529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9218a-e2e1-4c90-9ae4-64c234ee75ba admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:01.898427 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9218a-e2e1-4c90-9ae4-64c234ee75ba admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:01.903017 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e71eb-718e-4f91-9307-045a939e20f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:01.903674 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e71eb-718e-4f91-9307-045a939e20f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:01.903955 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e71eb-718e-4f91-9307-045a939e20f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:01.904227 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e71eb-718e-4f91-9307-045a939e20f7 admin admin] PATH_INFO: `/v3/projects/46020c10a44642938198ca5cd5c379c0/users/86fa37b40b1f404da7de68604dc7a8ce/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:01.906246 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e71eb-718e-4f91-9307-045a939e20f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46020c10a44642938198ca5cd5c379c0, user_id=86fa37b40b1f404da7de68604dc7a8ce, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:01.909156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e71eb-718e-4f91-9307-045a939e20f7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:01.919635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1317/2649] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:45:01 2022] PUT /identity/v3/projects/46020c10a44642938198ca5cd5c379c0/users/86fa37b40b1f404da7de68604dc7a8ce/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:45:03.133107 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c16ca-004d-4072-815b-efc3cc502fc2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:03.133580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c16ca-004d-4072-815b-efc3cc502fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:03.133580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c16ca-004d-4072-815b-efc3cc502fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:03.168058 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7c4c16ca-004d-4072-815b-efc3cc502fc2 None None] MFA Rules not processed for user `86fa37b40b1f404da7de68604dc7a8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:03.169436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c4c16ca-004d-4072-815b-efc3cc502fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:03.235230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:03.248597 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1333/2650] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:03.259823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c27d6-02ab-4196-afb9-50183400fc04 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:03.260378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c27d6-02ab-4196-afb9-50183400fc04 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:03.260378 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c27d6-02ab-4196-afb9-50183400fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:03.279828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8a6c27d6-02ab-4196-afb9-50183400fc04 None None] MFA Rules not processed for user `de895c1b657f41baaaa81bcb39b74c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:03.280862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a6c27d6-02ab-4196-afb9-50183400fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:03.340545 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1318/2651] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:03.352479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c16ca-004d-4072-815b-efc3cc502fc2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:03.353926 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c4c16ca-004d-4072-815b-efc3cc502fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:03.431071 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c16ca-004d-4072-815b-efc3cc502fc2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:03.436854 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa2d2d-6e17-431e-840b-101f0cca8314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:03.437517 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa2d2d-6e17-431e-840b-101f0cca8314 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:03.437799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa2d2d-6e17-431e-840b-101f0cca8314 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:03.438227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa2d2d-6e17-431e-840b-101f0cca8314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:03.447242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa2d2d-6e17-431e-840b-101f0cca8314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:03.448852 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa2d2d-6e17-431e-840b-101f0cca8314 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:03.457920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1334/2652] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:12.514335 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c27d6-02ab-4196-afb9-50183400fc04 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:12.517484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a6c27d6-02ab-4196-afb9-50183400fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:12.572476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:12.594129 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c27d6-02ab-4196-afb9-50183400fc04 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:12.599160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:12.599841 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:12.600127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:12.600446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] PATH_INFO: `/v3/users/126c021cc81e4c81b7e4d91da80e2fdd` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:12.601666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126c021cc81e4c81b7e4d91da80e2fdd)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:12.603657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:12.856907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126c021cc81e4c81b7e4d91da80e2fdd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:12.926233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126c021cc81e4c81b7e4d91da80e2fdd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:12.926845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126c021cc81e4c81b7e4d91da80e2fdd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:12.927495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126c021cc81e4c81b7e4d91da80e2fdd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:12.940392 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126c021cc81e4c81b7e4d91da80e2fdd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:12.955077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1319/2653] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:45:12 2022] DELETE /identity/v3/users/126c021cc81e4c81b7e4d91da80e2fdd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:45:12.961308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a4d62-4516-4292-a9a9-22d4ab35f308 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:12.961768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a4d62-4516-4292-a9a9-22d4ab35f308 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:12.961867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a4d62-4516-4292-a9a9-22d4ab35f308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:12.982027 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a95a4d62-4516-4292-a9a9-22d4ab35f308 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:12.983202 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a95a4d62-4516-4292-a9a9-22d4ab35f308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:13.042529 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1335/2654] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:13.053430 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:13.054840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:13.114660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d08a8b-1bb2-4b2f-97cd-63eb47433545 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:13.118509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e9ee2-7773-43c3-a852-cffa77ec1af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:13.119124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e9ee2-7773-43c3-a852-cffa77ec1af3 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:13.119408 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e9ee2-7773-43c3-a852-cffa77ec1af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:13.119679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e9ee2-7773-43c3-a852-cffa77ec1af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:13.128949 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e9ee2-7773-43c3-a852-cffa77ec1af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:13.130423 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e9ee2-7773-43c3-a852-cffa77ec1af3 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:13.140296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1320/2655] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:13.566108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a4d62-4516-4292-a9a9-22d4ab35f308 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:13.567521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a95a4d62-4516-4292-a9a9-22d4ab35f308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:13.581963 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a4d62-4516-4292-a9a9-22d4ab35f308 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:13.588053 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:13.588699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:13.589621 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:13.589912 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] PATH_INFO: `/v3/projects/48f010461b634944a22351b110e65fc3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:13.591280 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f010461b634944a22351b110e65fc3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:13.593302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:13.728214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f010461b634944a22351b110e65fc3', 'request_id': 'req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:13.734769 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f010461b634944a22351b110e65fc3', 'request_id': 'req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:13.740791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f010461b634944a22351b110e65fc3', 'request_id': 'req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:13.815971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] The token cache is being invalidate because project 48f010461b634944a22351b110e65fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:45:13.816593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:13.817096 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8791b8c4-1da9-45bb-910c-0ad54ae00cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:13.818694 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1336/2656] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:45:13 2022] DELETE /identity/v3/projects/48f010461b634944a22351b110e65fc3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:45:13.824079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e11b-e317-4b9d-bf3a-3a9f782aa0d6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:13.824536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e11b-e317-4b9d-bf3a-3a9f782aa0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:13.824675 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e11b-e317-4b9d-bf3a-3a9f782aa0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:13.844319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6ea7e11b-e317-4b9d-bf3a-3a9f782aa0d6 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:13.845551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ea7e11b-e317-4b9d-bf3a-3a9f782aa0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:13.905004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1321/2657] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:45:13.913491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c45e5-2d90-4b98-a882-aba367f702d5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:13.913714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c45e5-2d90-4b98-a882-aba367f702d5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:13.913988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c45e5-2d90-4b98-a882-aba367f702d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:13.921632 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:13.934933 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-030c45e5-2d90-4b98-a882-aba367f702d5 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:13.936172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-030c45e5-2d90-4b98-a882-aba367f702d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:13.944145 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1337/2658] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:13.948406 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7e11b-e317-4b9d-bf3a-3a9f782aa0d6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:13.958826 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7e11b-e317-4b9d-bf3a-3a9f782aa0d6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:13.963374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fab6c-a72f-4323-af6a-03cd97675fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:13.963977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fab6c-a72f-4323-af6a-03cd97675fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:13.964260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fab6c-a72f-4323-af6a-03cd97675fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:13.964534 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fab6c-a72f-4323-af6a-03cd97675fb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:13.965262 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fab6c-a72f-4323-af6a-03cd97675fb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:45:13.965566 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fab6c-a72f-4323-af6a-03cd97675fb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:13.967151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fab6c-a72f-4323-af6a-03cd97675fb5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:13.969496 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:13.979833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1322/2659] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:45:13.984081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c45e5-2d90-4b98-a882-aba367f702d5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:13.993857 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c45e5-2d90-4b98-a882-aba367f702d5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:13.998373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937dec0-2b14-4c4c-80af-73bb8998fd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:13.998969 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937dec0-2b14-4c4c-80af-73bb8998fd98 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:13.999246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937dec0-2b14-4c4c-80af-73bb8998fd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:13.999510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937dec0-2b14-4c4c-80af-73bb8998fd98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:14.000172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937dec0-2b14-4c4c-80af-73bb8998fd98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:14.002074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937dec0-2b14-4c4c-80af-73bb8998fd98 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:14.114844 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1338/2660] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:45:13 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:45:14.119000 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fab6c-a72f-4323-af6a-03cd97675fb5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:14.130507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fab6c-a72f-4323-af6a-03cd97675fb5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:14.191449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b195e-9cee-4a7b-a74d-b756ab67b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:14.192160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b195e-9cee-4a7b-a74d-b756ab67b619 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:14.192498 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b195e-9cee-4a7b-a74d-b756ab67b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:14.192960 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b195e-9cee-4a7b-a74d-b756ab67b619 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:14.193762 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b195e-9cee-4a7b-a74d-b756ab67b619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:14.196161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b195e-9cee-4a7b-a74d-b756ab67b619 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:14.382553 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1323/2661] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:45:14 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:45:14.386680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937dec0-2b14-4c4c-80af-73bb8998fd98 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:14.396925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937dec0-2b14-4c4c-80af-73bb8998fd98 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:14.401473 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869f2c3-d030-4920-8b6e-4a259aeb06bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:14.402074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869f2c3-d030-4920-8b6e-4a259aeb06bf admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:14.402349 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869f2c3-d030-4920-8b6e-4a259aeb06bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:14.402616 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869f2c3-d030-4920-8b6e-4a259aeb06bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:14.403300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869f2c3-d030-4920-8b6e-4a259aeb06bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:14.404869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869f2c3-d030-4920-8b6e-4a259aeb06bf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:14.415086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1339/2662] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:45:14.419046 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b195e-9cee-4a7b-a74d-b756ab67b619 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:14.429671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b195e-9cee-4a7b-a74d-b756ab67b619 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:14.434478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c31555-b110-42d3-8526-3c1e1831eaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:14.435087 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c31555-b110-42d3-8526-3c1e1831eaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:14.435364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c31555-b110-42d3-8526-3c1e1831eaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:14.435634 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c31555-b110-42d3-8526-3c1e1831eaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:14.436393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c31555-b110-42d3-8526-3c1e1831eaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:14.438021 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c31555-b110-42d3-8526-3c1e1831eaa5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:14.449230 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1324/2663] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:45:14.453228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869f2c3-d030-4920-8b6e-4a259aeb06bf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:14.463160 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869f2c3-d030-4920-8b6e-4a259aeb06bf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:14.467594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04e962-07c5-40f3-9a47-14800c2edaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:14.468236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04e962-07c5-40f3-9a47-14800c2edaff admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:14.468513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04e962-07c5-40f3-9a47-14800c2edaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:14.468781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04e962-07c5-40f3-9a47-14800c2edaff admin admin] PATH_INFO: `/v3/projects/17b69a7e4bbc443c922e699fdfd925b8/users/de8777f9a8c74f8b8912d79352a764da/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:14.483441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04e962-07c5-40f3-9a47-14800c2edaff admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b69a7e4bbc443c922e699fdfd925b8, user_id=de8777f9a8c74f8b8912d79352a764da, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:14.486141 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04e962-07c5-40f3-9a47-14800c2edaff admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:14.564911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1340/2664] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:45:14 2022] PUT /identity/v3/projects/17b69a7e4bbc443c922e699fdfd925b8/users/de8777f9a8c74f8b8912d79352a764da/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:45:14.570615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d2484-4334-4a96-8513-0f27f3ac936c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:14.570910 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d2484-4334-4a96-8513-0f27f3ac936c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:14.571189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d2484-4334-4a96-8513-0f27f3ac936c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:14.590615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-474d2484-4334-4a96-8513-0f27f3ac936c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:14.591820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-474d2484-4334-4a96-8513-0f27f3ac936c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:14.651738 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1325/2665] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:45:14.661976 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04e962-07c5-40f3-9a47-14800c2edaff admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:14.664051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd04e962-07c5-40f3-9a47-14800c2edaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:14.727413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04e962-07c5-40f3-9a47-14800c2edaff admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:14.731267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57587352-9a8b-4655-8e16-11df68f39eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:14.731916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57587352-9a8b-4655-8e16-11df68f39eee service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:14.732196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57587352-9a8b-4655-8e16-11df68f39eee service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:14.732468 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57587352-9a8b-4655-8e16-11df68f39eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:14.743585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57587352-9a8b-4655-8e16-11df68f39eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:14.745037 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57587352-9a8b-4655-8e16-11df68f39eee service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:14.756052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1341/2666] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:14.767850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d2484-4334-4a96-8513-0f27f3ac936c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:14.769677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-474d2484-4334-4a96-8513-0f27f3ac936c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:14.845104 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d2484-4334-4a96-8513-0f27f3ac936c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:14.851966 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52affc19-9e33-4032-bb28-14afe13519dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:14.852595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52affc19-9e33-4032-bb28-14afe13519dc service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:14.852879 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52affc19-9e33-4032-bb28-14afe13519dc service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:14.853170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52affc19-9e33-4032-bb28-14afe13519dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:14.855028 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-52affc19-9e33-4032-bb28-14afe13519dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:14.870393 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52affc19-9e33-4032-bb28-14afe13519dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:14.872217 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52affc19-9e33-4032-bb28-14afe13519dc service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:14.878414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:14.884971 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1326/2667] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:16.265624 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47abac1-7d9d-4467-abec-8d0e270c56f9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:16.267892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47abac1-7d9d-4467-abec-8d0e270c56f9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:16.267892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47abac1-7d9d-4467-abec-8d0e270c56f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:16.295862 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f47abac1-7d9d-4467-abec-8d0e270c56f9 None None] MFA Rules not processed for user `de8777f9a8c74f8b8912d79352a764da`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:16.297157 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f47abac1-7d9d-4467-abec-8d0e270c56f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:16.364420 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1342/2668] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:16.376692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52affc19-9e33-4032-bb28-14afe13519dc service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:16.376692 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-52affc19-9e33-4032-bb28-14afe13519dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:16.433297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52affc19-9e33-4032-bb28-14afe13519dc service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:16.437013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fd5d9-8de3-4968-9882-30908797c8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:16.437659 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fd5d9-8de3-4968-9882-30908797c8ab service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:16.437940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fd5d9-8de3-4968-9882-30908797c8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:16.438209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fd5d9-8de3-4968-9882-30908797c8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:16.446885 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fd5d9-8de3-4968-9882-30908797c8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:16.448315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fd5d9-8de3-4968-9882-30908797c8ab service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:16.457241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1327/2669] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:45:18.150392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b84c-032f-4671-bc4c-576e64bac986 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:18.157172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b84c-032f-4671-bc4c-576e64bac986 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:18.157172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b84c-032f-4671-bc4c-576e64bac986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:18.173091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5d81b84c-032f-4671-bc4c-576e64bac986 None None] MFA Rules not processed for user `de8777f9a8c74f8b8912d79352a764da`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:18.174322 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5d81b84c-032f-4671-bc4c-576e64bac986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:18.181897 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1343/2670] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:19.609798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fd5d9-8de3-4968-9882-30908797c8ab service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:19.611289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9c9fd5d9-8de3-4968-9882-30908797c8ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:19.623183 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fd5d9-8de3-4968-9882-30908797c8ab service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:19.626848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90647adf-6fd0-4952-9904-b66e44610816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:19.627451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90647adf-6fd0-4952-9904-b66e44610816 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:19.627734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90647adf-6fd0-4952-9904-b66e44610816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:19.628007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90647adf-6fd0-4952-9904-b66e44610816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:19.630307 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-90647adf-6fd0-4952-9904-b66e44610816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:19.693005 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90647adf-6fd0-4952-9904-b66e44610816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:19.694522 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90647adf-6fd0-4952-9904-b66e44610816 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:19.704029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1328/2671] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:28.165895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:29.699753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=56 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:42.390061 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81b84c-032f-4671-bc4c-576e64bac986 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:42.391520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5d81b84c-032f-4671-bc4c-576e64bac986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:42.463811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81b84c-032f-4671-bc4c-576e64bac986 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:42.469997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f3275-6476-41bd-8dae-ed1efa1997f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5593bc41bce41b4b44616c355976cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:42.470605 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f3275-6476-41bd-8dae-ed1efa1997f8 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:42.470886 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f3275-6476-41bd-8dae-ed1efa1997f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:42.471159 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f3275-6476-41bd-8dae-ed1efa1997f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:42.472911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f35f3275-6476-41bd-8dae-ed1efa1997f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:42.485236 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f3275-6476-41bd-8dae-ed1efa1997f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:42.486925 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f3275-6476-41bd-8dae-ed1efa1997f8 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:42.501175 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1344/2672] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:43.110160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90647adf-6fd0-4952-9904-b66e44610816 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:43.112458 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-90647adf-6fd0-4952-9904-b66e44610816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:43.125763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90647adf-6fd0-4952-9904-b66e44610816 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:43.130154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:43.130793 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:43.131101 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:43.131339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] PATH_INFO: `/v3/users/de895c1b657f41baaaa81bcb39b74c20` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:43.132483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de895c1b657f41baaaa81bcb39b74c20)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:43.134425 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:43.296397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de895c1b657f41baaaa81bcb39b74c20'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:43.382601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de895c1b657f41baaaa81bcb39b74c20'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:43.383226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de895c1b657f41baaaa81bcb39b74c20'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:43.383863 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de895c1b657f41baaaa81bcb39b74c20'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:43.399134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de895c1b657f41baaaa81bcb39b74c20'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:43.412788 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1329/2673] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:45:43 2022] DELETE /identity/v3/users/de895c1b657f41baaaa81bcb39b74c20 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:45:43.696260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f3275-6476-41bd-8dae-ed1efa1997f8 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:43.707405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f3275-6476-41bd-8dae-ed1efa1997f8 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:43.772686 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:43.773366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:43.773646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:43.773922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] PATH_INFO: `/v3/projects/9e3b79cfcd5a485b957787ecfd22159e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:43.775066 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3b79cfcd5a485b957787ecfd22159e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:43.777190 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:43.905354 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3b79cfcd5a485b957787ecfd22159e', 'request_id': 'req-d72913b6-0b05-4ab2-952d-76f937297bd4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:43.911425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3b79cfcd5a485b957787ecfd22159e', 'request_id': 'req-d72913b6-0b05-4ab2-952d-76f937297bd4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:43.917047 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3b79cfcd5a485b957787ecfd22159e', 'request_id': 'req-d72913b6-0b05-4ab2-952d-76f937297bd4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:43.986869 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] The token cache is being invalidate because project 9e3b79cfcd5a485b957787ecfd22159e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:45:43.987091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:43.987818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:43.989399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1345/2674] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:45:43 2022] DELETE /identity/v3/projects/9e3b79cfcd5a485b957787ecfd22159e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:45:43.993431 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:43.994813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:44.008054 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22953c1-613b-42de-a200-941cebbaeda2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:44.065449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ad12c-5d0a-4f80-8205-6fab0166d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:44.066077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ad12c-5d0a-4f80-8205-6fab0166d946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:44.066355 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ad12c-5d0a-4f80-8205-6fab0166d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:44.066628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ad12c-5d0a-4f80-8205-6fab0166d946 admin admin] PATH_INFO: `/v3/users/86fa37b40b1f404da7de68604dc7a8ce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:44.067782 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ad12c-5d0a-4f80-8205-6fab0166d946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86fa37b40b1f404da7de68604dc7a8ce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:44.069740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ad12c-5d0a-4f80-8205-6fab0166d946 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:44.260113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ff2ad12c-5d0a-4f80-8205-6fab0166d946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86fa37b40b1f404da7de68604dc7a8ce'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:44.320723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ff2ad12c-5d0a-4f80-8205-6fab0166d946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86fa37b40b1f404da7de68604dc7a8ce'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:44.321457 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ff2ad12c-5d0a-4f80-8205-6fab0166d946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86fa37b40b1f404da7de68604dc7a8ce'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:44.322067 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ff2ad12c-5d0a-4f80-8205-6fab0166d946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86fa37b40b1f404da7de68604dc7a8ce'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:44.334165 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ff2ad12c-5d0a-4f80-8205-6fab0166d946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86fa37b40b1f404da7de68604dc7a8ce'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:44.336074 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:44.347293 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1330/2675] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:45:43 2022] DELETE /identity/v3/users/86fa37b40b1f404da7de68604dc7a8ce => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:45:44.578623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:44.580016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:44.593969 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72913b6-0b05-4ab2-952d-76f937297bd4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:44.612739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:44.652537 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:44.653201 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:44.654569 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:44.654855 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] PATH_INFO: `/v3/projects/46020c10a44642938198ca5cd5c379c0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:44.656020 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46020c10a44642938198ca5cd5c379c0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:44.657950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:44.778084 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46020c10a44642938198ca5cd5c379c0', 'request_id': 'req-6853317f-e90e-4e1e-8d50-2c327ba15f17'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:44.784249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46020c10a44642938198ca5cd5c379c0', 'request_id': 'req-6853317f-e90e-4e1e-8d50-2c327ba15f17'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:44.790048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46020c10a44642938198ca5cd5c379c0', 'request_id': 'req-6853317f-e90e-4e1e-8d50-2c327ba15f17'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:44.882997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] The token cache is being invalidate because project 46020c10a44642938198ca5cd5c379c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:45:44.883290 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:44.883932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6853317f-e90e-4e1e-8d50-2c327ba15f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:45:44.885532 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1346/2676] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:45:44 2022] DELETE /identity/v3/projects/46020c10a44642938198ca5cd5c379c0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:45:44.891804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f443-8129-4c82-964f-bcf49eb72676 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:44.892592 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f443-8129-4c82-964f-bcf49eb72676 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:44.892881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f443-8129-4c82-964f-bcf49eb72676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:44.914518 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-75d2f443-8129-4c82-964f-bcf49eb72676 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:44.915820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-75d2f443-8129-4c82-964f-bcf49eb72676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:44.978325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1331/2677] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:44.986338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fec356-06ac-498b-9cae-ff8b00d16773 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:44.986782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fec356-06ac-498b-9cae-ff8b00d16773 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:44.987063 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fec356-06ac-498b-9cae-ff8b00d16773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:45.008748 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-55fec356-06ac-498b-9cae-ff8b00d16773 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:45.009997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-55fec356-06ac-498b-9cae-ff8b00d16773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:45.018547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1347/2678] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:45.022678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2f443-8129-4c82-964f-bcf49eb72676 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:45.032081 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2f443-8129-4c82-964f-bcf49eb72676 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:45.036542 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91643881-ae64-44b2-8340-c965a7800066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:45.037168 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643881-ae64-44b2-8340-c965a7800066 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:45.037447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643881-ae64-44b2-8340-c965a7800066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:45.037976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643881-ae64-44b2-8340-c965a7800066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:45.038661 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91643881-ae64-44b2-8340-c965a7800066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:45:45.038961 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91643881-ae64-44b2-8340-c965a7800066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:45.040598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91643881-ae64-44b2-8340-c965a7800066 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:45.051884 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1332/2679] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:45:45.055898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fec356-06ac-498b-9cae-ff8b00d16773 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:45.065502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fec356-06ac-498b-9cae-ff8b00d16773 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:45.070113 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67c782-8dad-4228-8f11-e9ea6d312111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:45.070715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67c782-8dad-4228-8f11-e9ea6d312111 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:45.070990 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67c782-8dad-4228-8f11-e9ea6d312111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:45.071256 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67c782-8dad-4228-8f11-e9ea6d312111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:45.071908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67c782-8dad-4228-8f11-e9ea6d312111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:45.073828 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67c782-8dad-4228-8f11-e9ea6d312111 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:45.345606 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1348/2680] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:45:45 2022] POST /identity/v3/projects => generated 377 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:45:45.349880 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91643881-ae64-44b2-8340-c965a7800066 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:45.360854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91643881-ae64-44b2-8340-c965a7800066 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:45.418245 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd38a19-fd60-4803-8274-2f1c0764c192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:45.418755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd38a19-fd60-4803-8274-2f1c0764c192 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:45.419579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd38a19-fd60-4803-8274-2f1c0764c192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:45.420007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd38a19-fd60-4803-8274-2f1c0764c192 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:45.420687 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd38a19-fd60-4803-8274-2f1c0764c192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:45.422641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd38a19-fd60-4803-8274-2f1c0764c192 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:45.520664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1333/2681] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:45:45 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:45:45.524779 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67c782-8dad-4228-8f11-e9ea6d312111 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:45.535739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67c782-8dad-4228-8f11-e9ea6d312111 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:45.540477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b482fdc-709a-4132-9464-5dd03e942470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:45.541075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b482fdc-709a-4132-9464-5dd03e942470 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:45.541382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b482fdc-709a-4132-9464-5dd03e942470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:45.541645 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b482fdc-709a-4132-9464-5dd03e942470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:45.542320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b482fdc-709a-4132-9464-5dd03e942470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:45.543901 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b482fdc-709a-4132-9464-5dd03e942470 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:45.554316 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1349/2682] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:45:45.558256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd38a19-fd60-4803-8274-2f1c0764c192 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:45.568133 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd38a19-fd60-4803-8274-2f1c0764c192 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:45.572681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1f0d7-3f66-4013-b20d-5228b68f709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:45.573316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f0d7-3f66-4013-b20d-5228b68f709f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:45.573601 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f0d7-3f66-4013-b20d-5228b68f709f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:45.573892 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1f0d7-3f66-4013-b20d-5228b68f709f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:45.574565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1f0d7-3f66-4013-b20d-5228b68f709f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:45.576676 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1f0d7-3f66-4013-b20d-5228b68f709f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:45.587305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1334/2683] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:45:45.591292 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b482fdc-709a-4132-9464-5dd03e942470 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:45.601791 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b482fdc-709a-4132-9464-5dd03e942470 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:45.606269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a552e4-33ed-41d7-a12d-8bedf1a882db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:45.607203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a552e4-33ed-41d7-a12d-8bedf1a882db admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:45.607472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a552e4-33ed-41d7-a12d-8bedf1a882db admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:45.607739 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a552e4-33ed-41d7-a12d-8bedf1a882db admin admin] PATH_INFO: `/v3/projects/c1a81a17da3d4575952e9991d1a4c4a1/users/71d46136bae74fa09cab3b6c6ea91a46/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:45.622521 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a552e4-33ed-41d7-a12d-8bedf1a882db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a81a17da3d4575952e9991d1a4c4a1, user_id=71d46136bae74fa09cab3b6c6ea91a46, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:45.629814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a552e4-33ed-41d7-a12d-8bedf1a882db admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:45.708034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1350/2684] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:45:45 2022] PUT /identity/v3/projects/c1a81a17da3d4575952e9991d1a4c4a1/users/71d46136bae74fa09cab3b6c6ea91a46/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:45:45.719532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdac1e-f625-4b42-865e-897b405cdecf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:45.719845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdac1e-f625-4b42-865e-897b405cdecf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:45.720119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdac1e-f625-4b42-865e-897b405cdecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:45.748990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0cfdac1e-f625-4b42-865e-897b405cdecf None None] MFA Rules not processed for user `71d46136bae74fa09cab3b6c6ea91a46`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:45.750295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0cfdac1e-f625-4b42-865e-897b405cdecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:45.799448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:45.820632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1335/2685] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:45.832091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a552e4-33ed-41d7-a12d-8bedf1a882db admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:45.833802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-98a552e4-33ed-41d7-a12d-8bedf1a882db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:45.885413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:45:45.891401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a552e4-33ed-41d7-a12d-8bedf1a882db admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:45.895110 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8371b6-183c-40cf-ac6c-a26321a2a6a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8753f3c218248abbf8018056c67b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:45.895721 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8371b6-183c-40cf-ac6c-a26321a2a6a9 service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:45.896001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8371b6-183c-40cf-ac6c-a26321a2a6a9 service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:45.896273 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8371b6-183c-40cf-ac6c-a26321a2a6a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:45.904499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8371b6-183c-40cf-ac6c-a26321a2a6a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:45.905939 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8371b6-183c-40cf-ac6c-a26321a2a6a9 service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:45.914823 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1351/2686] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:50.080554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0454d-432e-43ca-96ea-062256cbdf1c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:50.081082 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0454d-432e-43ca-96ea-062256cbdf1c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:50.081082 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0454d-432e-43ca-96ea-062256cbdf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:50.233548 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d2a0454d-432e-43ca-96ea-062256cbdf1c None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:50.234940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d2a0454d-432e-43ca-96ea-062256cbdf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:50.300490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1336/2687] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 28 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:50.314408 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8371b6-183c-40cf-ac6c-a26321a2a6a9 service glance] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:50.315874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3e8371b6-183c-40cf-ac6c-a26321a2a6a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:50.403659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8371b6-183c-40cf-ac6c-a26321a2a6a9 service glance] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:50.409766 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a1e4-fda3-43e8-8faa-3ea488711769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:50.410379 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a1e4-fda3-43e8-8faa-3ea488711769 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:50.410660 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a1e4-fda3-43e8-8faa-3ea488711769 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:50.410934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a1e4-fda3-43e8-8faa-3ea488711769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:50.419440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736a1e4-fda3-43e8-8faa-3ea488711769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:50.421796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736a1e4-fda3-43e8-8faa-3ea488711769 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:50.431246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1352/2688] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:52.515821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fdc7e-5bfa-4bc1-87bb-856fcfe67857 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:52.516395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fdc7e-5bfa-4bc1-87bb-856fcfe67857 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:52.516395 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fdc7e-5bfa-4bc1-87bb-856fcfe67857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:52.536710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6b5fdc7e-5bfa-4bc1-87bb-856fcfe67857 None None] MFA Rules not processed for user `da7325bdd4734bd38e45fbf74a837fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:52.538119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6b5fdc7e-5bfa-4bc1-87bb-856fcfe67857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:52.601295 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1337/2689] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:45:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:54.560950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0034131-0c4f-44b3-99b0-a594b83e81a3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:54.561675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0034131-0c4f-44b3-99b0-a594b83e81a3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:54.561675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0034131-0c4f-44b3-99b0-a594b83e81a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:54.582619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f0034131-0c4f-44b3-99b0-a594b83e81a3 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:54.583839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0034131-0c4f-44b3-99b0-a594b83e81a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:54.591772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1353/2690] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 28 05:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:54.606259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fdc7e-5bfa-4bc1-87bb-856fcfe67857 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:54.619857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fdc7e-5bfa-4bc1-87bb-856fcfe67857 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:54.625355 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9d46-2ce2-4782-a021-c9a090bccf75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:54.627160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9d46-2ce2-4782-a021-c9a090bccf75 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:54.627160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9d46-2ce2-4782-a021-c9a090bccf75 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:54.627160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9d46-2ce2-4782-a021-c9a090bccf75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:54.635014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba9d46-2ce2-4782-a021-c9a090bccf75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:54.636589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba9d46-2ce2-4782-a021-c9a090bccf75 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:54.647389 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1338/2691] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:45:58.188551 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59a7eb-19f0-4d2c-99a9-ba8bbf77e905 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:58.189706 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59a7eb-19f0-4d2c-99a9-ba8bbf77e905 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:58.190466 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59a7eb-19f0-4d2c-99a9-ba8bbf77e905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:58.212065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ea59a7eb-19f0-4d2c-99a9-ba8bbf77e905 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:45:58.213300 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ea59a7eb-19f0-4d2c-99a9-ba8bbf77e905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:58.221851 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1354/2692] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 28 05:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:45:58.309122 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9d46-2ce2-4782-a021-c9a090bccf75 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:45:58.310580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2cba9d46-2ce2-4782-a021-c9a090bccf75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:45:58.325999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9d46-2ce2-4782-a021-c9a090bccf75 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:45:58.333315 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed96cd6-b8da-4071-9fea-e4fb07e5d0e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:45:58.333933 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96cd6-b8da-4071-9fea-e4fb07e5d0e5 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:45:58.334213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96cd6-b8da-4071-9fea-e4fb07e5d0e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:45:58.334477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96cd6-b8da-4071-9fea-e4fb07e5d0e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:45:58.343438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed96cd6-b8da-4071-9fea-e4fb07e5d0e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:45:58.345113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed96cd6-b8da-4071-9fea-e4fb07e5d0e5 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:45:58.356066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1339/2693] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:46:02.163608 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59a7eb-19f0-4d2c-99a9-ba8bbf77e905 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:02.215055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59a7eb-19f0-4d2c-99a9-ba8bbf77e905 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:02.219579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:02.220213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:02.220492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:02.220765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] PATH_INFO: `/v3/users/71d46136bae74fa09cab3b6c6ea91a46` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:02.222665 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d46136bae74fa09cab3b6c6ea91a46)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:02.224572 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:02.374399 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d46136bae74fa09cab3b6c6ea91a46'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:46:02.375040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d46136bae74fa09cab3b6c6ea91a46'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:46:02.452315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d46136bae74fa09cab3b6c6ea91a46'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:46:02.452904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d46136bae74fa09cab3b6c6ea91a46'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:46:02.465403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d46136bae74fa09cab3b6c6ea91a46'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:46:02.469778 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:02.478628 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1355/2694] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:46:02 2022] DELETE /identity/v3/users/71d46136bae74fa09cab3b6c6ea91a46 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:46:02.483134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1078642-16c9-4150-8157-8fb754deca55 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:02.483667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1078642-16c9-4150-8157-8fb754deca55 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:02.483769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1078642-16c9-4150-8157-8fb754deca55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:02.532194 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e1078642-16c9-4150-8157-8fb754deca55 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:02.533409 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e1078642-16c9-4150-8157-8fb754deca55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:02.565883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:02.589561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1340/2695] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:02.600005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:02.601436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:02.679458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39f61e-df5b-4c90-8830-40dd0fcee8ed admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:02.683277 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d82f3-8904-4226-8f92-e72d54858d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:02.683895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d82f3-8904-4226-8f92-e72d54858d43 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:02.684173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d82f3-8904-4226-8f92-e72d54858d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:02.684444 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d82f3-8904-4226-8f92-e72d54858d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:02.694836 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d82f3-8904-4226-8f92-e72d54858d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:02.697935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d82f3-8904-4226-8f92-e72d54858d43 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:02.708413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1356/2696] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:46:02.913273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0531ad-4c3e-4135-9667-039fc8b8de6f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:02.913273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0531ad-4c3e-4135-9667-039fc8b8de6f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:02.913273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0531ad-4c3e-4135-9667-039fc8b8de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:02.970671 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fb0531ad-4c3e-4135-9667-039fc8b8de6f None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:02.972226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb0531ad-4c3e-4135-9667-039fc8b8de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:02.980828 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1341/2697] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 28 05:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:02.995814 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d82f3-8904-4226-8f92-e72d54858d43 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:02.998715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e06d82f3-8904-4226-8f92-e72d54858d43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:03.119535 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d82f3-8904-4226-8f92-e72d54858d43 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:03.125027 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732b246-7d21-4227-a3e2-06fb048bb1d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:03.125678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732b246-7d21-4227-a3e2-06fb048bb1d0 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:03.125958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732b246-7d21-4227-a3e2-06fb048bb1d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:03.126231 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732b246-7d21-4227-a3e2-06fb048bb1d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:03.134404 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732b246-7d21-4227-a3e2-06fb048bb1d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:03.135973 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732b246-7d21-4227-a3e2-06fb048bb1d0 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:03.145977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1357/2698] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:46:03.169115 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0531ad-4c3e-4135-9667-039fc8b8de6f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:03.170559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb0531ad-4c3e-4135-9667-039fc8b8de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:03.185176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0531ad-4c3e-4135-9667-039fc8b8de6f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:03.192018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:03.192678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:03.192959 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:03.193280 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] PATH_INFO: `/v3/projects/c1a81a17da3d4575952e9991d1a4c4a1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:03.194580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a81a17da3d4575952e9991d1a4c4a1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:03.196519 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:03.335894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a81a17da3d4575952e9991d1a4c4a1', 'request_id': 'req-9bc6154f-e406-4189-aa3e-a102e39cfa3e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:46:03.342130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a81a17da3d4575952e9991d1a4c4a1', 'request_id': 'req-9bc6154f-e406-4189-aa3e-a102e39cfa3e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:46:03.348235 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a81a17da3d4575952e9991d1a4c4a1', 'request_id': 'req-9bc6154f-e406-4189-aa3e-a102e39cfa3e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:46:03.438345 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] The token cache is being invalidate because project c1a81a17da3d4575952e9991d1a4c4a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:46:03.445039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:46:03.445039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9bc6154f-e406-4189-aa3e-a102e39cfa3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:46:03.445039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1342/2699] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:46:03 2022] DELETE /identity/v3/projects/c1a81a17da3d4575952e9991d1a4c4a1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:46:03.447526 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c73b2-403c-4589-afd4-ff0450898bc0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:03.447997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c73b2-403c-4589-afd4-ff0450898bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:03.448088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c73b2-403c-4589-afd4-ff0450898bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:03.469519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0c9c73b2-403c-4589-afd4-ff0450898bc0 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:03.470676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0c9c73b2-403c-4589-afd4-ff0450898bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:03.503932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:03.529189 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1358/2700] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:03.537353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de398e87-b18f-4aad-beba-023713cdfc20 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:03.538113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de398e87-b18f-4aad-beba-023713cdfc20 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:03.538211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de398e87-b18f-4aad-beba-023713cdfc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:03.558056 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-de398e87-b18f-4aad-beba-023713cdfc20 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:03.559243 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-de398e87-b18f-4aad-beba-023713cdfc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:03.568061 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1343/2701] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:03.572271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c73b2-403c-4589-afd4-ff0450898bc0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:03.582090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c73b2-403c-4589-afd4-ff0450898bc0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:03.586738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eccec3-6c6b-4aaa-89c7-f8a87ecbc513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:03.587343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eccec3-6c6b-4aaa-89c7-f8a87ecbc513 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:03.587622 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eccec3-6c6b-4aaa-89c7-f8a87ecbc513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:03.587891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eccec3-6c6b-4aaa-89c7-f8a87ecbc513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:03.588584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eccec3-6c6b-4aaa-89c7-f8a87ecbc513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:46:03.588883 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eccec3-6c6b-4aaa-89c7-f8a87ecbc513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:03.590502 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eccec3-6c6b-4aaa-89c7-f8a87ecbc513 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:03.602073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1359/2702] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:46:03.608483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de398e87-b18f-4aad-beba-023713cdfc20 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:03.618204 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de398e87-b18f-4aad-beba-023713cdfc20 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:03.623180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafdb3d-ec13-4977-85a1-550974139d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:03.623810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafdb3d-ec13-4977-85a1-550974139d75 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:03.624094 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafdb3d-ec13-4977-85a1-550974139d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:03.624368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafdb3d-ec13-4977-85a1-550974139d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:03.625041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafdb3d-ec13-4977-85a1-550974139d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:03.627020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafdb3d-ec13-4977-85a1-550974139d75 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:03.716694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1344/2703] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:46:03 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:46:03.720943 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eccec3-6c6b-4aaa-89c7-f8a87ecbc513 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:03.730896 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eccec3-6c6b-4aaa-89c7-f8a87ecbc513 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:03.786867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc94f-8653-4efe-a4a5-df6eeea585c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:03.787480 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc94f-8653-4efe-a4a5-df6eeea585c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:03.788024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc94f-8653-4efe-a4a5-df6eeea585c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:03.788296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc94f-8653-4efe-a4a5-df6eeea585c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:03.789006 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cc94f-8653-4efe-a4a5-df6eeea585c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:03.790950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cc94f-8653-4efe-a4a5-df6eeea585c9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:03.868724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1360/2704] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:46:03 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:46:03.873150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafdb3d-ec13-4977-85a1-550974139d75 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:03.885210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafdb3d-ec13-4977-85a1-550974139d75 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:03.889787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0deaf-7029-41c7-b5ec-1b7de7e57e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:03.890397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0deaf-7029-41c7-b5ec-1b7de7e57e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:03.890678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0deaf-7029-41c7-b5ec-1b7de7e57e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:03.891055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0deaf-7029-41c7-b5ec-1b7de7e57e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:03.891633 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0deaf-7029-41c7-b5ec-1b7de7e57e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:03.893272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0deaf-7029-41c7-b5ec-1b7de7e57e54 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:03.905173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1345/2705] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:46:03.908212 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc94f-8653-4efe-a4a5-df6eeea585c9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:03.920055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc94f-8653-4efe-a4a5-df6eeea585c9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:03.926252 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26043f-219d-4f61-a1f1-4d2ec4de72fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:03.926872 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26043f-219d-4f61-a1f1-4d2ec4de72fb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:03.927152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26043f-219d-4f61-a1f1-4d2ec4de72fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:03.928033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26043f-219d-4f61-a1f1-4d2ec4de72fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:03.928260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26043f-219d-4f61-a1f1-4d2ec4de72fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:03.929889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26043f-219d-4f61-a1f1-4d2ec4de72fb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:03.941219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1361/2706] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:46:03.945373 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0deaf-7029-41c7-b5ec-1b7de7e57e54 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:03.955691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0deaf-7029-41c7-b5ec-1b7de7e57e54 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:03.960609 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf12c5-e45b-42e1-922f-5e93f9e4b782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:03.961305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf12c5-e45b-42e1-922f-5e93f9e4b782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:03.961608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf12c5-e45b-42e1-922f-5e93f9e4b782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:03.961844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf12c5-e45b-42e1-922f-5e93f9e4b782 admin admin] PATH_INFO: `/v3/projects/6e915a25c14e4aeca31264d0a12342a4/users/ce1b29e93568472082a94f9ffc2543be/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:03.977695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf12c5-e45b-42e1-922f-5e93f9e4b782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e915a25c14e4aeca31264d0a12342a4, user_id=ce1b29e93568472082a94f9ffc2543be, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:03.980359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf12c5-e45b-42e1-922f-5e93f9e4b782 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:04.052218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1346/2707] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:46:03 2022] PUT /identity/v3/projects/6e915a25c14e4aeca31264d0a12342a4/users/ce1b29e93568472082a94f9ffc2543be/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:46:04.057356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced4fb0-a684-4f5c-b4a7-6e8044e05441 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:04.057647 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced4fb0-a684-4f5c-b4a7-6e8044e05441 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:04.057922 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced4fb0-a684-4f5c-b4a7-6e8044e05441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:04.077149 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cced4fb0-a684-4f5c-b4a7-6e8044e05441 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:04.078391 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cced4fb0-a684-4f5c-b4a7-6e8044e05441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:04.136248 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1362/2708] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:04.146738 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf12c5-e45b-42e1-922f-5e93f9e4b782 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:04.148438 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0abf12c5-e45b-42e1-922f-5e93f9e4b782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:04.191682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:04.217424 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf12c5-e45b-42e1-922f-5e93f9e4b782 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:04.221112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5faa2-d166-428a-a59c-7bba0e9f45ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:04.221774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5faa2-d166-428a-a59c-7bba0e9f45ba service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:04.222193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5faa2-d166-428a-a59c-7bba0e9f45ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:04.222473 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5faa2-d166-428a-a59c-7bba0e9f45ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:04.231493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5faa2-d166-428a-a59c-7bba0e9f45ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:04.232917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5faa2-d166-428a-a59c-7bba0e9f45ba service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:04.242942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1347/2709] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:46:06.125553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa588b2c-7ed3-48d2-9d07-b68c079fb0c8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:06.126070 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa588b2c-7ed3-48d2-9d07-b68c079fb0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:06.126244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa588b2c-7ed3-48d2-9d07-b68c079fb0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:06.149474 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fa588b2c-7ed3-48d2-9d07-b68c079fb0c8 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:06.152936 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fa588b2c-7ed3-48d2-9d07-b68c079fb0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:06.165079 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1363/2710] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 28 05:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:06.188294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5faa2-d166-428a-a59c-7bba0e9f45ba service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:06.191743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-99b5faa2-d166-428a-a59c-7bba0e9f45ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:06.279047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5faa2-d166-428a-a59c-7bba0e9f45ba service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:06.290331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2164dd-f7ee-45f1-bbe4-b85b1d27aa49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:06.290969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2164dd-f7ee-45f1-bbe4-b85b1d27aa49 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:06.298255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2164dd-f7ee-45f1-bbe4-b85b1d27aa49 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:06.298255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2164dd-f7ee-45f1-bbe4-b85b1d27aa49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:06.308375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2164dd-f7ee-45f1-bbe4-b85b1d27aa49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:06.310097 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2164dd-f7ee-45f1-bbe4-b85b1d27aa49 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:06.321077 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1348/2711] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:46:09.472052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e94ee-2e81-439b-b723-9e3054275388 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:09.472983 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e94ee-2e81-439b-b723-9e3054275388 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:09.473407 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e94ee-2e81-439b-b723-9e3054275388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:09.506841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-856e94ee-2e81-439b-b723-9e3054275388 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:09.514499 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-856e94ee-2e81-439b-b723-9e3054275388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:09.528582 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1364/2712] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 28 05:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:09.544920 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2164dd-f7ee-45f1-bbe4-b85b1d27aa49 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:09.546483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4c2164dd-f7ee-45f1-bbe4-b85b1d27aa49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:09.562636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2164dd-f7ee-45f1-bbe4-b85b1d27aa49 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:09.570516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fdc4c-ebe3-47d3-b4f1-23e493b17461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:09.574251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fdc4c-ebe3-47d3-b4f1-23e493b17461 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:09.574251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fdc4c-ebe3-47d3-b4f1-23e493b17461 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:09.574251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fdc4c-ebe3-47d3-b4f1-23e493b17461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:09.583526 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fdc4c-ebe3-47d3-b4f1-23e493b17461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:09.585620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fdc4c-ebe3-47d3-b4f1-23e493b17461 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:09.597643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1349/2713] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:46:10.837031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c555a3-bd13-44e9-95fd-cd95f0b87d2b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:10.837580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c555a3-bd13-44e9-95fd-cd95f0b87d2b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:10.837580 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c555a3-bd13-44e9-95fd-cd95f0b87d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:10.866663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a1c555a3-bd13-44e9-95fd-cd95f0b87d2b None None] MFA Rules not processed for user `ce1b29e93568472082a94f9ffc2543be`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:10.868034 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a1c555a3-bd13-44e9-95fd-cd95f0b87d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:10.890143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:10.934151 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1365/2714] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:46:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:10.938653 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fdc4c-ebe3-47d3-b4f1-23e493b17461 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:10.948974 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fdc4c-ebe3-47d3-b4f1-23e493b17461 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:10.953740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc2fa7-7d53-4738-8d91-13cc15cee391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:10.954621 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc2fa7-7d53-4738-8d91-13cc15cee391 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:10.954902 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc2fa7-7d53-4738-8d91-13cc15cee391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:10.955193 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc2fa7-7d53-4738-8d91-13cc15cee391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:10.956485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc2fa7-7d53-4738-8d91-13cc15cee391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:10.958434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc2fa7-7d53-4738-8d91-13cc15cee391 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:11.043432 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1350/2715] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:46:10 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:46:11.047772 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c555a3-bd13-44e9-95fd-cd95f0b87d2b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:11.060249 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c555a3-bd13-44e9-95fd-cd95f0b87d2b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:11.125666 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db7598-4939-4cee-aad3-fd2fd243f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:11.126514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db7598-4939-4cee-aad3-fd2fd243f69b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:11.126863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db7598-4939-4cee-aad3-fd2fd243f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:11.127242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db7598-4939-4cee-aad3-fd2fd243f69b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:11.128673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db7598-4939-4cee-aad3-fd2fd243f69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:11.130984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db7598-4939-4cee-aad3-fd2fd243f69b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:11.211978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1366/2716] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:46:11 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:46:11.216093 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc2fa7-7d53-4738-8d91-13cc15cee391 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:11.228541 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc2fa7-7d53-4738-8d91-13cc15cee391 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:11.234996 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf98e95-5075-4684-af7a-feaa615b2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:11.235615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf98e95-5075-4684-af7a-feaa615b2df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:11.235895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf98e95-5075-4684-af7a-feaa615b2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:11.236163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf98e95-5075-4684-af7a-feaa615b2df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:11.236856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf98e95-5075-4684-af7a-feaa615b2df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:11.239113 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf98e95-5075-4684-af7a-feaa615b2df1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:11.250371 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1351/2717] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:46:11.255315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db7598-4939-4cee-aad3-fd2fd243f69b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:11.265895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db7598-4939-4cee-aad3-fd2fd243f69b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:11.270803 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d0022-0752-460d-9b67-be258f51f374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:11.272276 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d0022-0752-460d-9b67-be258f51f374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:11.272276 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d0022-0752-460d-9b67-be258f51f374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:11.272276 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d0022-0752-460d-9b67-be258f51f374 admin admin] PATH_INFO: `/v3/projects/d95d50b7e1bb4b0e945056195af754eb/users/e94332a7f6c24fad85ec1ddd0482f30c/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:11.293710 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d0022-0752-460d-9b67-be258f51f374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95d50b7e1bb4b0e945056195af754eb, user_id=e94332a7f6c24fad85ec1ddd0482f30c, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:11.296415 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d0022-0752-460d-9b67-be258f51f374 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:11.422945 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1367/2718] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:46:11 2022] PUT /identity/v3/projects/d95d50b7e1bb4b0e945056195af754eb/users/e94332a7f6c24fad85ec1ddd0482f30c/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:46:11.426872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf98e95-5075-4684-af7a-feaa615b2df1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:11.436865 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf98e95-5075-4684-af7a-feaa615b2df1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:11.501587 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c97d6-547e-4597-abd3-9fe0647f9b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:11.502226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c97d6-547e-4597-abd3-9fe0647f9b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:11.503244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c97d6-547e-4597-abd3-9fe0647f9b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:11.503709 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c97d6-547e-4597-abd3-9fe0647f9b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:11.504536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c97d6-547e-4597-abd3-9fe0647f9b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:11.506188 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c97d6-547e-4597-abd3-9fe0647f9b71 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:11.523483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d0022-0752-460d-9b67-be258f51f374 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:11.535035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1352/2719] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:46:11.542299 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d0022-0752-460d-9b67-be258f51f374 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:11.549149 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3348803-d46f-41ef-b6fa-2217323a2f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:11.551003 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348803-d46f-41ef-b6fa-2217323a2f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:11.551282 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348803-d46f-41ef-b6fa-2217323a2f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:11.551737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3348803-d46f-41ef-b6fa-2217323a2f5f admin admin] PATH_INFO: `/v3/projects/d95d50b7e1bb4b0e945056195af754eb/users/e94332a7f6c24fad85ec1ddd0482f30c/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:11.553813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3348803-d46f-41ef-b6fa-2217323a2f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95d50b7e1bb4b0e945056195af754eb, user_id=e94332a7f6c24fad85ec1ddd0482f30c, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:11.556609 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3348803-d46f-41ef-b6fa-2217323a2f5f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:11.569228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1368/2720] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:46:11 2022] PUT /identity/v3/projects/d95d50b7e1bb4b0e945056195af754eb/users/e94332a7f6c24fad85ec1ddd0482f30c/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:46:17.100594 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167a41-f6b6-4330-8a13-7feb5dac9bf4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:17.101155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167a41-f6b6-4330-8a13-7feb5dac9bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:17.101273 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04167a41-f6b6-4330-8a13-7feb5dac9bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:17.116007 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:17.139090 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-04167a41-f6b6-4330-8a13-7feb5dac9bf4 None None] MFA Rules not processed for user `e94332a7f6c24fad85ec1ddd0482f30c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:17.139090 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04167a41-f6b6-4330-8a13-7feb5dac9bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:17.216583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1353/2721] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:46:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:46:17.234910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3348803-d46f-41ef-b6fa-2217323a2f5f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:17.237962 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f3348803-d46f-41ef-b6fa-2217323a2f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:17.335213 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3348803-d46f-41ef-b6fa-2217323a2f5f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:17.348271 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a94b0-0167-420c-b237-91706cb39933 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8753f3c218248abbf8018056c67b923', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:17.349032 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a94b0-0167-420c-b237-91706cb39933 service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:17.349440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a94b0-0167-420c-b237-91706cb39933 service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:17.349781 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a94b0-0167-420c-b237-91706cb39933 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:17.399599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:17.433118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a94b0-0167-420c-b237-91706cb39933 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:17.434602 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a94b0-0167-420c-b237-91706cb39933 service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:17.448796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1369/2722] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:46:17.756987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae361d7d-7127-4139-b0b4-8e4a05746828 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:17.757313 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae361d7d-7127-4139-b0b4-8e4a05746828 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:17.757590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae361d7d-7127-4139-b0b4-8e4a05746828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:17.796607 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ae361d7d-7127-4139-b0b4-8e4a05746828 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:17.798039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae361d7d-7127-4139-b0b4-8e4a05746828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:17.856459 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1354/2723] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:46:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:18.011406 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a94b0-0167-420c-b237-91706cb39933 service glance] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:18.012884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d62a94b0-0167-420c-b237-91706cb39933 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:18.087355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a94b0-0167-420c-b237-91706cb39933 service glance] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:18.092391 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3cc06-c1be-4f0d-90ba-836fcc2d03ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:18.093073 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3cc06-c1be-4f0d-90ba-836fcc2d03ab service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:18.093380 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3cc06-c1be-4f0d-90ba-836fcc2d03ab service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:18.093655 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3cc06-c1be-4f0d-90ba-836fcc2d03ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:18.102581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3cc06-c1be-4f0d-90ba-836fcc2d03ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:18.104177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3cc06-c1be-4f0d-90ba-836fcc2d03ab service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:18.113445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1370/2724] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:46:19.772375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae361d7d-7127-4139-b0b4-8e4a05746828 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:19.774737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae361d7d-7127-4139-b0b4-8e4a05746828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:19.903596 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae361d7d-7127-4139-b0b4-8e4a05746828 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:19.911728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017930a-10c0-4018-b393-01b3365faba7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5593bc41bce41b4b44616c355976cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:19.912397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017930a-10c0-4018-b393-01b3365faba7 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:19.912677 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017930a-10c0-4018-b393-01b3365faba7 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:19.913241 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017930a-10c0-4018-b393-01b3365faba7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:19.915189 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5017930a-10c0-4018-b393-01b3365faba7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:19.928695 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017930a-10c0-4018-b393-01b3365faba7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:19.930383 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017930a-10c0-4018-b393-01b3365faba7 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:19.935236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:19.942587 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1355/2725] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:46:26.566393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6e9c-5f2e-4270-931e-c161853dde01 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:26.566867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6e9c-5f2e-4270-931e-c161853dde01 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:26.566966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6e9c-5f2e-4270-931e-c161853dde01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:26.588587 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0e3e6e9c-5f2e-4270-931e-c161853dde01 None None] MFA Rules not processed for user `de8777f9a8c74f8b8912d79352a764da`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:26.589839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0e3e6e9c-5f2e-4270-931e-c161853dde01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:26.653346 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1371/2726] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:29.183136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987c938-1a3c-4713-a26e-1d5d683b32b8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:29.183629 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987c938-1a3c-4713-a26e-1d5d683b32b8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:29.183738 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987c938-1a3c-4713-a26e-1d5d683b32b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:29.202971 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f987c938-1a3c-4713-a26e-1d5d683b32b8 None None] MFA Rules not processed for user `ce1b29e93568472082a94f9ffc2543be`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:29.204155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f987c938-1a3c-4713-a26e-1d5d683b32b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:29.211348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1356/2727] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:46:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:33.300695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ed132-67d1-44a0-a54e-747998ffb39a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:33.301242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ed132-67d1-44a0-a54e-747998ffb39a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:33.301433 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ed132-67d1-44a0-a54e-747998ffb39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:33.324086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-544ed132-67d1-44a0-a54e-747998ffb39a None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:33.325805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-544ed132-67d1-44a0-a54e-747998ffb39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:33.334016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1372/2728] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Jul 28 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:33.349329 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987c938-1a3c-4713-a26e-1d5d683b32b8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:33.362583 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987c938-1a3c-4713-a26e-1d5d683b32b8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:33.367629 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee33f47-d882-4624-af31-259c5356fb7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:33.368240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee33f47-d882-4624-af31-259c5356fb7d service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:33.368516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee33f47-d882-4624-af31-259c5356fb7d service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:33.369362 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee33f47-d882-4624-af31-259c5356fb7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:33.378728 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee33f47-d882-4624-af31-259c5356fb7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:33.380706 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee33f47-d882-4624-af31-259c5356fb7d service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:33.392348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1357/2729] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:46:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:46:43.317854 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=74 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:43.388286 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:46:48.018335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea726d-507a-48dc-94d8-12d14ac0e907 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:48.018822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea726d-507a-48dc-94d8-12d14ac0e907 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:48.018822 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea726d-507a-48dc-94d8-12d14ac0e907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:48.038718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-55ea726d-507a-48dc-94d8-12d14ac0e907 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:48.039915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-55ea726d-507a-48dc-94d8-12d14ac0e907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:48.098657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1373/2730] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 28 05:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:48.113125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee33f47-d882-4624-af31-259c5356fb7d service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:48.187338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee33f47-d882-4624-af31-259c5356fb7d service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:48.193187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7951833-5fc7-4603-bd63-79d247421a6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:48.193833 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951833-5fc7-4603-bd63-79d247421a6a service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:48.194111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951833-5fc7-4603-bd63-79d247421a6a service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:48.194383 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7951833-5fc7-4603-bd63-79d247421a6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:48.202957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7951833-5fc7-4603-bd63-79d247421a6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:48.204605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7951833-5fc7-4603-bd63-79d247421a6a service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:48.215219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1358/2731] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:46:52.625438 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094fbde-deb9-461b-8b44-46948c3bfe32 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:52.626171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094fbde-deb9-461b-8b44-46948c3bfe32 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:52.626171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094fbde-deb9-461b-8b44-46948c3bfe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:52.646320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3094fbde-deb9-461b-8b44-46948c3bfe32 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:52.649656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3094fbde-deb9-461b-8b44-46948c3bfe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:52.656588 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1374/2732] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 28 05:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:52.671112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7951833-5fc7-4603-bd63-79d247421a6a service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:52.682221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7951833-5fc7-4603-bd63-79d247421a6a service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:52.687987 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed72be6-1ce4-4364-a188-10951562abb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:52.688611 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed72be6-1ce4-4364-a188-10951562abb3 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:52.688928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed72be6-1ce4-4364-a188-10951562abb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:52.689221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed72be6-1ce4-4364-a188-10951562abb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:52.697466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed72be6-1ce4-4364-a188-10951562abb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:52.699944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed72be6-1ce4-4364-a188-10951562abb3 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:52.709428 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1359/2733] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:46:55.934599 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094fbde-deb9-461b-8b44-46948c3bfe32 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:56.000304 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094fbde-deb9-461b-8b44-46948c3bfe32 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:56.003935 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16722855-0603-4590-9aae-d1ed9b1db634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:56.004546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16722855-0603-4590-9aae-d1ed9b1db634 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:56.005001 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16722855-0603-4590-9aae-d1ed9b1db634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:56.005330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16722855-0603-4590-9aae-d1ed9b1db634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:56.015129 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16722855-0603-4590-9aae-d1ed9b1db634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:56.016722 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16722855-0603-4590-9aae-d1ed9b1db634 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:56.026561 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1375/2734] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:46:56.477041 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910fb60-3375-4c01-8364-df205c31e4ca None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:56.477567 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910fb60-3375-4c01-8364-df205c31e4ca None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:56.477653 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910fb60-3375-4c01-8364-df205c31e4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:56.498491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9910fb60-3375-4c01-8364-df205c31e4ca None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:56.499787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9910fb60-3375-4c01-8364-df205c31e4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:56.507889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1360/2735] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 28 05:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:56.523679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16722855-0603-4590-9aae-d1ed9b1db634 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:56.536578 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16722855-0603-4590-9aae-d1ed9b1db634 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:56.542306 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d49d9d-e034-4ce7-9788-be6ae159bba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:56.543124 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d49d9d-e034-4ce7-9788-be6ae159bba6 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:56.543629 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d49d9d-e034-4ce7-9788-be6ae159bba6 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:56.543905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d49d9d-e034-4ce7-9788-be6ae159bba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:56.552090 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d49d9d-e034-4ce7-9788-be6ae159bba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:56.558139 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d49d9d-e034-4ce7-9788-be6ae159bba6 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:56.563610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1376/2736] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:46:59.698594 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c55bd-1805-4a94-b5ac-d264103b95f5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:59.699807 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c55bd-1805-4a94-b5ac-d264103b95f5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:59.699971 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c55bd-1805-4a94-b5ac-d264103b95f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:59.718957 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-051c55bd-1805-4a94-b5ac-d264103b95f5 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:46:59.720236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-051c55bd-1805-4a94-b5ac-d264103b95f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:46:59.728127 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1361/2737] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 28 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:46:59.757524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d49d9d-e034-4ce7-9788-be6ae159bba6 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:46:59.769827 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d49d9d-e034-4ce7-9788-be6ae159bba6 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:46:59.775511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c4647-6383-44c4-a225-703e6f3df2c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:46:59.776125 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4647-6383-44c4-a225-703e6f3df2c5 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:46:59.776457 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4647-6383-44c4-a225-703e6f3df2c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:46:59.776672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4647-6383-44c4-a225-703e6f3df2c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:46:59.786261 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c4647-6383-44c4-a225-703e6f3df2c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:46:59.787994 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c4647-6383-44c4-a225-703e6f3df2c5 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:46:59.799222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1377/2738] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:47:02.981211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c93e3-bd8e-4e91-8697-18239f78f687 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:02.981904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c93e3-bd8e-4e91-8697-18239f78f687 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:02.981904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c93e3-bd8e-4e91-8697-18239f78f687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:03.000678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-365c93e3-bd8e-4e91-8697-18239f78f687 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:03.001913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-365c93e3-bd8e-4e91-8697-18239f78f687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:03.009857 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1362/2739] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Jul 28 05:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:03.025890 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c4647-6383-44c4-a225-703e6f3df2c5 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:03.037841 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c4647-6383-44c4-a225-703e6f3df2c5 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:03.043646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38d658-4f08-4064-9fea-9b38760f1826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531ebc9dee0440888b94a6bf17d7a335', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:03.044263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38d658-4f08-4064-9fea-9b38760f1826 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:03.044544 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38d658-4f08-4064-9fea-9b38760f1826 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:03.044816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38d658-4f08-4064-9fea-9b38760f1826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:03.053287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38d658-4f08-4064-9fea-9b38760f1826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:03.054840 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38d658-4f08-4064-9fea-9b38760f1826 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:03.064675 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1378/2740] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:47:12.995529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=49 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:13.060254 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=78 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:18.619313 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c93e3-bd8e-4e91-8697-18239f78f687 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:18.620861 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-365c93e3-bd8e-4e91-8697-18239f78f687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:18.634935 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c93e3-bd8e-4e91-8697-18239f78f687 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:18.639836 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b810c0a-0e1e-4118-9150-70bf1b0dbf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:18.640476 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810c0a-0e1e-4118-9150-70bf1b0dbf12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:18.649781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810c0a-0e1e-4118-9150-70bf1b0dbf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:18.649781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810c0a-0e1e-4118-9150-70bf1b0dbf12 admin admin] PATH_INFO: `/v3/users/da7325bdd4734bd38e45fbf74a837fc1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:18.649781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b810c0a-0e1e-4118-9150-70bf1b0dbf12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7325bdd4734bd38e45fbf74a837fc1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:18.649781 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b810c0a-0e1e-4118-9150-70bf1b0dbf12 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:18.815559 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b810c0a-0e1e-4118-9150-70bf1b0dbf12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7325bdd4734bd38e45fbf74a837fc1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:18.868945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b810c0a-0e1e-4118-9150-70bf1b0dbf12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7325bdd4734bd38e45fbf74a837fc1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:18.869590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b810c0a-0e1e-4118-9150-70bf1b0dbf12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7325bdd4734bd38e45fbf74a837fc1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:18.870196 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b810c0a-0e1e-4118-9150-70bf1b0dbf12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7325bdd4734bd38e45fbf74a837fc1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:18.894279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b810c0a-0e1e-4118-9150-70bf1b0dbf12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7325bdd4734bd38e45fbf74a837fc1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:18.908426 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1363/2741] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:47:18 2022] DELETE /identity/v3/users/da7325bdd4734bd38e45fbf74a837fc1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:19.145868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38d658-4f08-4064-9fea-9b38760f1826 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:19.156123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38d658-4f08-4064-9fea-9b38760f1826 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:19.213775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:19.214411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:19.214688 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:19.214959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] PATH_INFO: `/v3/projects/5c59c1f081b74e78b60364e7a701e129` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:19.216302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c59c1f081b74e78b60364e7a701e129)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:19.218363 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:19.346308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c59c1f081b74e78b60364e7a701e129', 'request_id': 'req-827fb642-7ff2-42f0-b240-83385f279600'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:19.352471 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c59c1f081b74e78b60364e7a701e129', 'request_id': 'req-827fb642-7ff2-42f0-b240-83385f279600'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:19.358114 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c59c1f081b74e78b60364e7a701e129', 'request_id': 'req-827fb642-7ff2-42f0-b240-83385f279600'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:19.426777 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] The token cache is being invalidate because project 5c59c1f081b74e78b60364e7a701e129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:47:19.427019 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:19.427671 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-827fb642-7ff2-42f0-b240-83385f279600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:19.429193 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1379/2742] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:47:19 2022] DELETE /identity/v3/projects/5c59c1f081b74e78b60364e7a701e129 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:19.434819 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a65a3-7ea6-4654-af97-bd643393551a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:19.435281 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a65a3-7ea6-4654-af97-bd643393551a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:19.435564 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a65a3-7ea6-4654-af97-bd643393551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:19.455740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a46a65a3-7ea6-4654-af97-bd643393551a None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:19.456919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a46a65a3-7ea6-4654-af97-bd643393551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:19.516111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1364/2743] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:19.524036 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5024ec4-c1e0-4a3f-9cc3-a11eb402fa15 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:19.524316 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5024ec4-c1e0-4a3f-9cc3-a11eb402fa15 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:19.524585 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5024ec4-c1e0-4a3f-9cc3-a11eb402fa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:19.544743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e5024ec4-c1e0-4a3f-9cc3-a11eb402fa15 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:19.545988 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e5024ec4-c1e0-4a3f-9cc3-a11eb402fa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:19.553758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1380/2744] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:19.557872 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a65a3-7ea6-4654-af97-bd643393551a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:19.568313 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a65a3-7ea6-4654-af97-bd643393551a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:19.572997 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba65870-64f1-4098-95da-813aa381782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:19.573688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba65870-64f1-4098-95da-813aa381782c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:19.573968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba65870-64f1-4098-95da-813aa381782c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:19.574240 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba65870-64f1-4098-95da-813aa381782c admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:19.574984 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba65870-64f1-4098-95da-813aa381782c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:47:19.575289 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba65870-64f1-4098-95da-813aa381782c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:19.576888 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba65870-64f1-4098-95da-813aa381782c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:19.588220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1365/2745] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:47:19.592419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5024ec4-c1e0-4a3f-9cc3-a11eb402fa15 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:19.601420 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5024ec4-c1e0-4a3f-9cc3-a11eb402fa15 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:19.606672 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ed81b-35be-4d3a-9398-6b89df7ece27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:19.607320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ed81b-35be-4d3a-9398-6b89df7ece27 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:19.607595 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ed81b-35be-4d3a-9398-6b89df7ece27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:19.607863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ed81b-35be-4d3a-9398-6b89df7ece27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:19.608520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ed81b-35be-4d3a-9398-6b89df7ece27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:19.610419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ed81b-35be-4d3a-9398-6b89df7ece27 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:19.693579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1381/2746] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:47:19 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:19.697550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba65870-64f1-4098-95da-813aa381782c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:19.707846 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba65870-64f1-4098-95da-813aa381782c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:19.763719 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44961-8dc0-446b-a3b7-8918aa53a904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:19.764322 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44961-8dc0-446b-a3b7-8918aa53a904 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:19.764605 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44961-8dc0-446b-a3b7-8918aa53a904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:19.764878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44961-8dc0-446b-a3b7-8918aa53a904 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:19.765568 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f44961-8dc0-446b-a3b7-8918aa53a904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:19.767478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f44961-8dc0-446b-a3b7-8918aa53a904 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:19.775172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:19.838524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1366/2747] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:47:19 2022] POST /identity/v3/users => generated 302 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:19.843512 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ed81b-35be-4d3a-9398-6b89df7ece27 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:19.853764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ed81b-35be-4d3a-9398-6b89df7ece27 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:19.860364 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7ab57-ee9c-4764-9484-013d506fb44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:19.860971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7ab57-ee9c-4764-9484-013d506fb44a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:19.861284 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7ab57-ee9c-4764-9484-013d506fb44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:19.861557 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7ab57-ee9c-4764-9484-013d506fb44a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:19.862238 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7ab57-ee9c-4764-9484-013d506fb44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:19.863809 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7ab57-ee9c-4764-9484-013d506fb44a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:19.873877 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1382/2748] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:19.877886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44961-8dc0-446b-a3b7-8918aa53a904 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:19.888510 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44961-8dc0-446b-a3b7-8918aa53a904 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:19.893318 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c56a9-fc12-4279-bc4b-c7c12d325306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:19.900886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c56a9-fc12-4279-bc4b-c7c12d325306 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:19.900886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c56a9-fc12-4279-bc4b-c7c12d325306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:19.900886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c56a9-fc12-4279-bc4b-c7c12d325306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:19.900886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c56a9-fc12-4279-bc4b-c7c12d325306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:19.900886 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c56a9-fc12-4279-bc4b-c7c12d325306 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:19.908124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1367/2749] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:19.912344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7ab57-ee9c-4764-9484-013d506fb44a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:19.923310 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7ab57-ee9c-4764-9484-013d506fb44a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:19.928072 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfef837-c698-467d-9912-876c41fe261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:19.932264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef837-c698-467d-9912-876c41fe261b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:19.932264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef837-c698-467d-9912-876c41fe261b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:19.932264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef837-c698-467d-9912-876c41fe261b admin admin] PATH_INFO: `/v3/projects/e79dde30d4ad4c2ebd446dd6a6360f11/users/f48992f3348e4275be70ed5684028a55/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:19.944920 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfef837-c698-467d-9912-876c41fe261b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79dde30d4ad4c2ebd446dd6a6360f11, user_id=f48992f3348e4275be70ed5684028a55, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:19.947592 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfef837-c698-467d-9912-876c41fe261b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:20.039782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1383/2750] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:19 2022] PUT /identity/v3/projects/e79dde30d4ad4c2ebd446dd6a6360f11/users/f48992f3348e4275be70ed5684028a55/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:20.051613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7fef7-7ae2-4cd9-9f09-102079e3006b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:20.051985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7fef7-7ae2-4cd9-9f09-102079e3006b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:20.052265 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7fef7-7ae2-4cd9-9f09-102079e3006b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:20.079900 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d1d7fef7-7ae2-4cd9-9f09-102079e3006b None None] MFA Rules not processed for user `f48992f3348e4275be70ed5684028a55`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:20.081107 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d1d7fef7-7ae2-4cd9-9f09-102079e3006b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:20.146039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1368/2751] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:20.150743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfef837-c698-467d-9912-876c41fe261b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:20.188173 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:20.219980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfef837-c698-467d-9912-876c41fe261b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:20.224742 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883497-3161-4b50-967e-abdebe06213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:20.225393 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883497-3161-4b50-967e-abdebe06213a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:20.231392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883497-3161-4b50-967e-abdebe06213a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:20.231392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883497-3161-4b50-967e-abdebe06213a admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:20.231392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22883497-3161-4b50-967e-abdebe06213a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:20.231392 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22883497-3161-4b50-967e-abdebe06213a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:20.346876 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1384/2752] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:47:20 2022] POST /identity/v3/projects => generated 403 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:20.350376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7fef7-7ae2-4cd9-9f09-102079e3006b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:20.361850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7fef7-7ae2-4cd9-9f09-102079e3006b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:20.419715 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e38ef-b502-4dd9-b52b-99598a00fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:20.420336 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e38ef-b502-4dd9-b52b-99598a00fef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:20.420620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e38ef-b502-4dd9-b52b-99598a00fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:20.420895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e38ef-b502-4dd9-b52b-99598a00fef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:20.421608 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e38ef-b502-4dd9-b52b-99598a00fef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:20.423595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e38ef-b502-4dd9-b52b-99598a00fef5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:20.512749 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1369/2753] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:47:20 2022] POST /identity/v3/users => generated 308 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:20.514108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883497-3161-4b50-967e-abdebe06213a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:20.525481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883497-3161-4b50-967e-abdebe06213a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:20.530286 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd6015-a9a8-45f7-8725-974655eefb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:20.530892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd6015-a9a8-45f7-8725-974655eefb2c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:20.531177 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd6015-a9a8-45f7-8725-974655eefb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:20.531434 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd6015-a9a8-45f7-8725-974655eefb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:20.532120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd6015-a9a8-45f7-8725-974655eefb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:20.533767 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd6015-a9a8-45f7-8725-974655eefb2c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:20.545186 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1385/2754] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:47:20.549331 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e38ef-b502-4dd9-b52b-99598a00fef5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:20.563565 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e38ef-b502-4dd9-b52b-99598a00fef5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:20.569253 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770880f-8f18-4cf2-856e-f9b21f9b4e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:20.569927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770880f-8f18-4cf2-856e-f9b21f9b4e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:20.570211 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770880f-8f18-4cf2-856e-f9b21f9b4e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:20.570490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770880f-8f18-4cf2-856e-f9b21f9b4e7a admin admin] PATH_INFO: `/v3/projects/8fd0cf90ce5c4485a6bb41598bc0fba7/users/652cff6b357d477e800a7bd84ad738ab/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:20.587660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770880f-8f18-4cf2-856e-f9b21f9b4e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd0cf90ce5c4485a6bb41598bc0fba7, user_id=652cff6b357d477e800a7bd84ad738ab, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:20.590892 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770880f-8f18-4cf2-856e-f9b21f9b4e7a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:20.679055 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1370/2755] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:20 2022] PUT /identity/v3/projects/8fd0cf90ce5c4485a6bb41598bc0fba7/users/652cff6b357d477e800a7bd84ad738ab/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:47:20.683222 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd6015-a9a8-45f7-8725-974655eefb2c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:20.693498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd6015-a9a8-45f7-8725-974655eefb2c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:20.751977 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e726a-b292-4640-89eb-753e0a19c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:20.752522 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e726a-b292-4640-89eb-753e0a19c299 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:20.752805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e726a-b292-4640-89eb-753e0a19c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:20.753081 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e726a-b292-4640-89eb-753e0a19c299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:20.753802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e726a-b292-4640-89eb-753e0a19c299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:20.755411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e726a-b292-4640-89eb-753e0a19c299 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:20.764987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1386/2756] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:20.769506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770880f-8f18-4cf2-856e-f9b21f9b4e7a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:20.780401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770880f-8f18-4cf2-856e-f9b21f9b4e7a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:20.784981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea0282-51b1-41c0-9508-040b247ed091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:20.785769 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea0282-51b1-41c0-9508-040b247ed091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:20.786044 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea0282-51b1-41c0-9508-040b247ed091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:20.786309 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea0282-51b1-41c0-9508-040b247ed091 admin admin] PATH_INFO: `/v3/projects/8fd0cf90ce5c4485a6bb41598bc0fba7/users/652cff6b357d477e800a7bd84ad738ab/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:20.788492 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea0282-51b1-41c0-9508-040b247ed091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd0cf90ce5c4485a6bb41598bc0fba7, user_id=652cff6b357d477e800a7bd84ad738ab, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:20.791125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea0282-51b1-41c0-9508-040b247ed091 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:20.803090 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1371/2757] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:20 2022] PUT /identity/v3/projects/8fd0cf90ce5c4485a6bb41598bc0fba7/users/652cff6b357d477e800a7bd84ad738ab/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:20.813564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740a855-e6b2-4506-a783-fe8546cecd74 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:20.813856 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740a855-e6b2-4506-a783-fe8546cecd74 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:20.814199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740a855-e6b2-4506-a783-fe8546cecd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:20.842200 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1740a855-e6b2-4506-a783-fe8546cecd74 None None] MFA Rules not processed for user `652cff6b357d477e800a7bd84ad738ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:20.843409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1740a855-e6b2-4506-a783-fe8546cecd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:20.910794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1387/2758] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:20.923264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea0282-51b1-41c0-9508-040b247ed091 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:20.924925 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-57ea0282-51b1-41c0-9508-040b247ed091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:20.947770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:21.003078 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea0282-51b1-41c0-9508-040b247ed091 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:21.006746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af0f13-5083-4482-80bb-7b9722469365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:21.007351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af0f13-5083-4482-80bb-7b9722469365 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:21.007631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af0f13-5083-4482-80bb-7b9722469365 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:21.007898 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af0f13-5083-4482-80bb-7b9722469365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:21.017743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af0f13-5083-4482-80bb-7b9722469365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:21.019170 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af0f13-5083-4482-80bb-7b9722469365 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:21.029775 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1372/2759] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:47:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:47:21.165384 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740a855-e6b2-4506-a783-fe8546cecd74 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:21.190893 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:21.228337 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740a855-e6b2-4506-a783-fe8546cecd74 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:21.233018 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:21.233615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:21.233900 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:21.234176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] PATH_INFO: `/v3/users/f48992f3348e4275be70ed5684028a55` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:21.235424 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48992f3348e4275be70ed5684028a55)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:21.237366 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:21.460821 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48992f3348e4275be70ed5684028a55'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:21.461488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48992f3348e4275be70ed5684028a55'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:21.524401 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48992f3348e4275be70ed5684028a55'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:21.525016 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48992f3348e4275be70ed5684028a55'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:21.537075 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48992f3348e4275be70ed5684028a55'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:21.549978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1388/2760] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:47:21 2022] DELETE /identity/v3/users/f48992f3348e4275be70ed5684028a55 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:21.554524 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7532c5-2ea4-4b29-a888-365b4c37d439 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:21.554804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7532c5-2ea4-4b29-a888-365b4c37d439 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:21.555069 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7532c5-2ea4-4b29-a888-365b4c37d439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:21.574539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1d7532c5-2ea4-4b29-a888-365b4c37d439 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:21.576655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1d7532c5-2ea4-4b29-a888-365b4c37d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:21.640447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1373/2761] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:21.649678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:21.651391 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:21.725352 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ada7c-f0d7-496e-83fb-152836c6ada2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:21.728890 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07ca06-245b-4920-b96e-91259f7cc296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:21.729536 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07ca06-245b-4920-b96e-91259f7cc296 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:21.729818 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07ca06-245b-4920-b96e-91259f7cc296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:21.730094 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07ca06-245b-4920-b96e-91259f7cc296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:21.739566 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07ca06-245b-4920-b96e-91259f7cc296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:21.740993 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07ca06-245b-4920-b96e-91259f7cc296 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:21.751166 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1389/2762] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:47:22.186822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7532c5-2ea4-4b29-a888-365b4c37d439 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:22.188260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1d7532c5-2ea4-4b29-a888-365b4c37d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:22.201778 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7532c5-2ea4-4b29-a888-365b4c37d439 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:22.206586 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:22.207222 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:22.207619 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:22.207895 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] PATH_INFO: `/v3/projects/e79dde30d4ad4c2ebd446dd6a6360f11` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:22.209220 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79dde30d4ad4c2ebd446dd6a6360f11)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:22.211136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:22.352981 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79dde30d4ad4c2ebd446dd6a6360f11', 'request_id': 'req-eb7cf01d-116f-44d6-a16b-711198e05baf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:22.359475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79dde30d4ad4c2ebd446dd6a6360f11', 'request_id': 'req-eb7cf01d-116f-44d6-a16b-711198e05baf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:22.365125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79dde30d4ad4c2ebd446dd6a6360f11', 'request_id': 'req-eb7cf01d-116f-44d6-a16b-711198e05baf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:22.446118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] The token cache is being invalidate because project e79dde30d4ad4c2ebd446dd6a6360f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:47:22.446412 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:22.447032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:22.448538 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1374/2763] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:47:22 2022] DELETE /identity/v3/projects/e79dde30d4ad4c2ebd446dd6a6360f11 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:22.453172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07ca06-245b-4920-b96e-91259f7cc296 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:22.462684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07ca06-245b-4920-b96e-91259f7cc296 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:22.493495 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:22.520153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f46b20-1abb-41a7-a705-79ea3fac7d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:22.520785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f46b20-1abb-41a7-a705-79ea3fac7d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:22.521059 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f46b20-1abb-41a7-a705-79ea3fac7d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:22.521354 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f46b20-1abb-41a7-a705-79ea3fac7d78 admin admin] PATH_INFO: `/v3/users/652cff6b357d477e800a7bd84ad738ab` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:22.522511 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f46b20-1abb-41a7-a705-79ea3fac7d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=652cff6b357d477e800a7bd84ad738ab)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:22.524414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f46b20-1abb-41a7-a705-79ea3fac7d78 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:22.680555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-45f46b20-1abb-41a7-a705-79ea3fac7d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652cff6b357d477e800a7bd84ad738ab'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:22.681183 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-45f46b20-1abb-41a7-a705-79ea3fac7d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652cff6b357d477e800a7bd84ad738ab'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:22.737396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-45f46b20-1abb-41a7-a705-79ea3fac7d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652cff6b357d477e800a7bd84ad738ab'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:22.738013 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-45f46b20-1abb-41a7-a705-79ea3fac7d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652cff6b357d477e800a7bd84ad738ab'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:22.750811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-45f46b20-1abb-41a7-a705-79ea3fac7d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652cff6b357d477e800a7bd84ad738ab'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:22.763452 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1390/2764] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:47:22 2022] DELETE /identity/v3/users/652cff6b357d477e800a7bd84ad738ab => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:23.183310 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:23.185881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:23.199613 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cf01d-116f-44d6-a16b-711198e05baf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:23.228108 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:23.260031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:23.260669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:23.260950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:23.261298 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] PATH_INFO: `/v3/projects/8fd0cf90ce5c4485a6bb41598bc0fba7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:23.262382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd0cf90ce5c4485a6bb41598bc0fba7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:23.264279 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:23.372381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd0cf90ce5c4485a6bb41598bc0fba7', 'request_id': 'req-584d17b9-cae5-480e-8397-3426834846f6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:23.378927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd0cf90ce5c4485a6bb41598bc0fba7', 'request_id': 'req-584d17b9-cae5-480e-8397-3426834846f6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:23.384999 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd0cf90ce5c4485a6bb41598bc0fba7', 'request_id': 'req-584d17b9-cae5-480e-8397-3426834846f6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:23.468529 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] The token cache is being invalidate because project 8fd0cf90ce5c4485a6bb41598bc0fba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:47:23.468723 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:23.469535 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-584d17b9-cae5-480e-8397-3426834846f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:23.474595 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1375/2765] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:47:23 2022] DELETE /identity/v3/projects/8fd0cf90ce5c4485a6bb41598bc0fba7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:23.479024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676d8e-f168-458c-aa63-c0f151adb3e2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:23.479024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676d8e-f168-458c-aa63-c0f151adb3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:23.479024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676d8e-f168-458c-aa63-c0f151adb3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:23.500895 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-10676d8e-f168-458c-aa63-c0f151adb3e2 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:23.502330 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-10676d8e-f168-458c-aa63-c0f151adb3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:23.563745 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1391/2766] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:47:23.571796 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19672ef-9ecb-460b-b2e3-963bdb94155e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:23.572145 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19672ef-9ecb-460b-b2e3-963bdb94155e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:23.572491 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19672ef-9ecb-460b-b2e3-963bdb94155e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:23.593282 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c19672ef-9ecb-460b-b2e3-963bdb94155e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:23.594486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c19672ef-9ecb-460b-b2e3-963bdb94155e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:23.602694 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1376/2767] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:23.607811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10676d8e-f168-458c-aa63-c0f151adb3e2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:23.617774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10676d8e-f168-458c-aa63-c0f151adb3e2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:23.622829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc4de-125e-4966-8d0c-0b798b4eed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:23.626735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc4de-125e-4966-8d0c-0b798b4eed83 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:23.626735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc4de-125e-4966-8d0c-0b798b4eed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:23.626735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc4de-125e-4966-8d0c-0b798b4eed83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:23.626735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cc4de-125e-4966-8d0c-0b798b4eed83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:47:23.626735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cc4de-125e-4966-8d0c-0b798b4eed83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:23.626735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cc4de-125e-4966-8d0c-0b798b4eed83 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:23.638808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1392/2768] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 05:47:23.643171 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19672ef-9ecb-460b-b2e3-963bdb94155e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:23.652643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19672ef-9ecb-460b-b2e3-963bdb94155e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:23.658010 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c19c2c-6992-464a-bd3f-ed76dcb4b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:23.658615 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19c2c-6992-464a-bd3f-ed76dcb4b437 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:23.658894 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19c2c-6992-464a-bd3f-ed76dcb4b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:23.659163 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19c2c-6992-464a-bd3f-ed76dcb4b437 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:23.659821 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c19c2c-6992-464a-bd3f-ed76dcb4b437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:23.661759 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c19c2c-6992-464a-bd3f-ed76dcb4b437 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:23.773455 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1377/2769] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:47:23 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:23.778436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc4de-125e-4966-8d0c-0b798b4eed83 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:23.788892 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc4de-125e-4966-8d0c-0b798b4eed83 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:23.827947 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:23.846649 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e77998-2053-45b7-a70f-039f622cdd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:23.847269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e77998-2053-45b7-a70f-039f622cdd39 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:23.847545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e77998-2053-45b7-a70f-039f622cdd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:23.847817 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e77998-2053-45b7-a70f-039f622cdd39 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:23.848483 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e77998-2053-45b7-a70f-039f622cdd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:23.850436 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e77998-2053-45b7-a70f-039f622cdd39 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:23.944143 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1393/2770] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:47:23 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:23.948292 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c19c2c-6992-464a-bd3f-ed76dcb4b437 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:23.959012 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c19c2c-6992-464a-bd3f-ed76dcb4b437 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:23.964049 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fe7a9-8758-4894-8551-8342941a75e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:23.964779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fe7a9-8758-4894-8551-8342941a75e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:23.966374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fe7a9-8758-4894-8551-8342941a75e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:23.966374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fe7a9-8758-4894-8551-8342941a75e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:23.967053 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fe7a9-8758-4894-8551-8342941a75e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:23.968651 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fe7a9-8758-4894-8551-8342941a75e3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:23.979090 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1378/2771] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:23.983351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e77998-2053-45b7-a70f-039f622cdd39 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:23.993315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e77998-2053-45b7-a70f-039f622cdd39 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:23.998116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b00fb1-4068-4c43-a266-f6aa7264b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:23.998746 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b00fb1-4068-4c43-a266-f6aa7264b16c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:23.999026 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b00fb1-4068-4c43-a266-f6aa7264b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:23.999297 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b00fb1-4068-4c43-a266-f6aa7264b16c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:23.999987 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b00fb1-4068-4c43-a266-f6aa7264b16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:24.001617 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b00fb1-4068-4c43-a266-f6aa7264b16c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:24.011798 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1394/2772] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:24.016532 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fe7a9-8758-4894-8551-8342941a75e3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:24.029599 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fe7a9-8758-4894-8551-8342941a75e3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:24.032177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d99c57-4661-44f1-ab62-fb0dd253309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:24.032819 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d99c57-4661-44f1-ab62-fb0dd253309f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:24.033488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d99c57-4661-44f1-ab62-fb0dd253309f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:24.033866 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d99c57-4661-44f1-ab62-fb0dd253309f admin admin] PATH_INFO: `/v3/projects/2b477654ade443cd915c7be04903b2c4/users/17320ee3bd6941aca3c26e9e00759cd9/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:24.049004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d99c57-4661-44f1-ab62-fb0dd253309f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b477654ade443cd915c7be04903b2c4, user_id=17320ee3bd6941aca3c26e9e00759cd9, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:24.051806 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d99c57-4661-44f1-ab62-fb0dd253309f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:24.126635 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1379/2773] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:24 2022] PUT /identity/v3/projects/2b477654ade443cd915c7be04903b2c4/users/17320ee3bd6941aca3c26e9e00759cd9/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:24.138479 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3ffba-4eeb-450f-86e4-983a2b1da10a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:24.138762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3ffba-4eeb-450f-86e4-983a2b1da10a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:24.139042 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3ffba-4eeb-450f-86e4-983a2b1da10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:24.169519 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4fd3ffba-4eeb-450f-86e4-983a2b1da10a None None] MFA Rules not processed for user `17320ee3bd6941aca3c26e9e00759cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:24.170752 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4fd3ffba-4eeb-450f-86e4-983a2b1da10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:24.234579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1395/2774] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:24.239138 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d99c57-4661-44f1-ab62-fb0dd253309f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:24.295180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:24.306803 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d99c57-4661-44f1-ab62-fb0dd253309f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:24.314039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839388a6-2d33-491e-a719-64265caa4d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:24.314946 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839388a6-2d33-491e-a719-64265caa4d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:24.315582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839388a6-2d33-491e-a719-64265caa4d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:24.315889 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839388a6-2d33-491e-a719-64265caa4d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:24.316757 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839388a6-2d33-491e-a719-64265caa4d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:24.318824 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839388a6-2d33-491e-a719-64265caa4d44 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:24.419737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1380/2775] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:47:24 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:47:24.423762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3ffba-4eeb-450f-86e4-983a2b1da10a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:24.436196 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3ffba-4eeb-450f-86e4-983a2b1da10a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:24.505083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626918d4-847b-4ea4-b670-0b695ca91810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:24.505765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626918d4-847b-4ea4-b670-0b695ca91810 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:24.506155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626918d4-847b-4ea4-b670-0b695ca91810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:24.506538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626918d4-847b-4ea4-b670-0b695ca91810 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:24.507310 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626918d4-847b-4ea4-b670-0b695ca91810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:24.510199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626918d4-847b-4ea4-b670-0b695ca91810 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:24.613613 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1396/2776] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:47:24 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:47:24.617742 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839388a6-2d33-491e-a719-64265caa4d44 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:24.629825 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839388a6-2d33-491e-a719-64265caa4d44 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:24.634896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a2e34-2279-4150-b1c7-3c7000c60068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:24.635838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2e34-2279-4150-b1c7-3c7000c60068 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:24.635971 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2e34-2279-4150-b1c7-3c7000c60068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:24.636205 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2e34-2279-4150-b1c7-3c7000c60068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:24.636893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a2e34-2279-4150-b1c7-3c7000c60068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:24.639015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a2e34-2279-4150-b1c7-3c7000c60068 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:24.649581 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1381/2777] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:24.654547 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626918d4-847b-4ea4-b670-0b695ca91810 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:24.665274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626918d4-847b-4ea4-b670-0b695ca91810 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:24.671230 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191d230-d8dd-4ea1-9d07-e7ffb781f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:24.671894 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191d230-d8dd-4ea1-9d07-e7ffb781f204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:24.672172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191d230-d8dd-4ea1-9d07-e7ffb781f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:24.672443 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191d230-d8dd-4ea1-9d07-e7ffb781f204 admin admin] PATH_INFO: `/v3/projects/40fbc9ff787c4508a0771ce2d56a5fdc/users/0a0349bf08ee440c9819aa2e75738946/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:24.688568 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191d230-d8dd-4ea1-9d07-e7ffb781f204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fbc9ff787c4508a0771ce2d56a5fdc, user_id=0a0349bf08ee440c9819aa2e75738946, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:24.691247 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191d230-d8dd-4ea1-9d07-e7ffb781f204 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:24.782220 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1397/2778] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:24 2022] PUT /identity/v3/projects/40fbc9ff787c4508a0771ce2d56a5fdc/users/0a0349bf08ee440c9819aa2e75738946/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:47:24.786267 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a2e34-2279-4150-b1c7-3c7000c60068 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:24.796804 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a2e34-2279-4150-b1c7-3c7000c60068 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:24.853049 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88656983-a620-4a23-8dcd-1b65a645c33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:24.853698 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88656983-a620-4a23-8dcd-1b65a645c33c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:24.853978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88656983-a620-4a23-8dcd-1b65a645c33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:24.854250 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88656983-a620-4a23-8dcd-1b65a645c33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:24.855052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88656983-a620-4a23-8dcd-1b65a645c33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:24.856741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88656983-a620-4a23-8dcd-1b65a645c33c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:24.866630 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1382/2779] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:24.870932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191d230-d8dd-4ea1-9d07-e7ffb781f204 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:24.881684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191d230-d8dd-4ea1-9d07-e7ffb781f204 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:24.886351 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0b815-9630-4f19-a9aa-61a44b70e2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:24.887007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b815-9630-4f19-a9aa-61a44b70e2db admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:24.887825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b815-9630-4f19-a9aa-61a44b70e2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:24.888098 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b815-9630-4f19-a9aa-61a44b70e2db admin admin] PATH_INFO: `/v3/projects/40fbc9ff787c4508a0771ce2d56a5fdc/users/0a0349bf08ee440c9819aa2e75738946/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:24.890272 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0b815-9630-4f19-a9aa-61a44b70e2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fbc9ff787c4508a0771ce2d56a5fdc, user_id=0a0349bf08ee440c9819aa2e75738946, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:24.892911 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0b815-9630-4f19-a9aa-61a44b70e2db admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:24.899153 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:24.904397 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1398/2780] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:24 2022] PUT /identity/v3/projects/40fbc9ff787c4508a0771ce2d56a5fdc/users/0a0349bf08ee440c9819aa2e75738946/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:47:24.915234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8350-e15a-4160-b124-7ec54328ae5f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:24.915515 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8350-e15a-4160-b124-7ec54328ae5f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:24.915786 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8350-e15a-4160-b124-7ec54328ae5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:24.943258 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6c6d8350-e15a-4160-b124-7ec54328ae5f None None] MFA Rules not processed for user `0a0349bf08ee440c9819aa2e75738946`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:24.944445 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6c6d8350-e15a-4160-b124-7ec54328ae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:25.021328 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1383/2781] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:25.034033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0b815-9630-4f19-a9aa-61a44b70e2db admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:25.035762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3cc0b815-9630-4f19-a9aa-61a44b70e2db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:25.096302 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0b815-9630-4f19-a9aa-61a44b70e2db admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:25.099981 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db3d78-f8aa-4ea8-8693-2d35b44d9c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:25.100593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3d78-f8aa-4ea8-8693-2d35b44d9c14 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:25.100875 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3d78-f8aa-4ea8-8693-2d35b44d9c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:25.101168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3d78-f8aa-4ea8-8693-2d35b44d9c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:25.110210 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db3d78-f8aa-4ea8-8693-2d35b44d9c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:25.111584 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db3d78-f8aa-4ea8-8693-2d35b44d9c14 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:25.120989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1399/2782] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:47:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:47:25.351153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8350-e15a-4160-b124-7ec54328ae5f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:25.361039 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8350-e15a-4160-b124-7ec54328ae5f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:25.364936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7678f1d-7e42-4427-b70f-77ef46a01011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:25.365582 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7678f1d-7e42-4427-b70f-77ef46a01011 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:25.365858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7678f1d-7e42-4427-b70f-77ef46a01011 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:25.372277 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7678f1d-7e42-4427-b70f-77ef46a01011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:25.410919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:25.423313 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7678f1d-7e42-4427-b70f-77ef46a01011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:25.424747 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7678f1d-7e42-4427-b70f-77ef46a01011 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:25.433539 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1384/2783] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:47:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:47:34.053979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db3d78-f8aa-4ea8-8693-2d35b44d9c14 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:34.121294 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db3d78-f8aa-4ea8-8693-2d35b44d9c14 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:34.126603 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:34.127361 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:34.127559 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:34.127765 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] PATH_INFO: `/v3/users/17320ee3bd6941aca3c26e9e00759cd9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:34.128915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17320ee3bd6941aca3c26e9e00759cd9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:34.130863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:34.343227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17320ee3bd6941aca3c26e9e00759cd9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:34.343889 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17320ee3bd6941aca3c26e9e00759cd9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:34.423335 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17320ee3bd6941aca3c26e9e00759cd9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:34.423960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17320ee3bd6941aca3c26e9e00759cd9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:34.438908 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17320ee3bd6941aca3c26e9e00759cd9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:34.451464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1400/2784] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:47:34 2022] DELETE /identity/v3/users/17320ee3bd6941aca3c26e9e00759cd9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:34.456177 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28caf00-32bc-4cc7-bbae-97767005cf92 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:34.456680 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28caf00-32bc-4cc7-bbae-97767005cf92 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:34.456807 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28caf00-32bc-4cc7-bbae-97767005cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:34.476986 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a28caf00-32bc-4cc7-bbae-97767005cf92 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:34.478332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a28caf00-32bc-4cc7-bbae-97767005cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:34.536557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1385/2785] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:34.547138 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:34.548556 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:34.575588 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:34.606232 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb933db3-436b-4828-91d5-12c5df4e3e7f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:34.610610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42614261-7e3d-4c74-81cb-798280d72613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:34.611221 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42614261-7e3d-4c74-81cb-798280d72613 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:34.611501 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42614261-7e3d-4c74-81cb-798280d72613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:34.611774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42614261-7e3d-4c74-81cb-798280d72613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:34.621396 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42614261-7e3d-4c74-81cb-798280d72613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:34.623782 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42614261-7e3d-4c74-81cb-798280d72613 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:34.633321 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1401/2786] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:47:35.125976 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28caf00-32bc-4cc7-bbae-97767005cf92 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:35.127493 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a28caf00-32bc-4cc7-bbae-97767005cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:35.141928 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28caf00-32bc-4cc7-bbae-97767005cf92 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:35.146843 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:35.147484 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:35.147767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:35.148034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] PATH_INFO: `/v3/projects/2b477654ade443cd915c7be04903b2c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:35.149212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b477654ade443cd915c7be04903b2c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:35.151213 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:35.256792 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b477654ade443cd915c7be04903b2c4', 'request_id': 'req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:35.262890 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b477654ade443cd915c7be04903b2c4', 'request_id': 'req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:35.268882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b477654ade443cd915c7be04903b2c4', 'request_id': 'req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:35.348495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] The token cache is being invalidate because project 2b477654ade443cd915c7be04903b2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:47:35.348784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:35.349450 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:35.350939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1386/2787] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:47:35 2022] DELETE /identity/v3/projects/2b477654ade443cd915c7be04903b2c4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:35.355253 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42614261-7e3d-4c74-81cb-798280d72613 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:35.364897 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42614261-7e3d-4c74-81cb-798280d72613 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:35.426065 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6770fb-ae45-4539-aefa-4ae6602f9534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:35.426714 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6770fb-ae45-4539-aefa-4ae6602f9534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:35.427009 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6770fb-ae45-4539-aefa-4ae6602f9534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:35.427273 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6770fb-ae45-4539-aefa-4ae6602f9534 admin admin] PATH_INFO: `/v3/users/0a0349bf08ee440c9819aa2e75738946` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:35.428666 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6770fb-ae45-4539-aefa-4ae6602f9534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0349bf08ee440c9819aa2e75738946)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:35.430634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6770fb-ae45-4539-aefa-4ae6602f9534 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:35.603192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6d6770fb-ae45-4539-aefa-4ae6602f9534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0349bf08ee440c9819aa2e75738946'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:35.603850 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6d6770fb-ae45-4539-aefa-4ae6602f9534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0349bf08ee440c9819aa2e75738946'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:35.675169 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6d6770fb-ae45-4539-aefa-4ae6602f9534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0349bf08ee440c9819aa2e75738946'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:35.675806 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6d6770fb-ae45-4539-aefa-4ae6602f9534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0349bf08ee440c9819aa2e75738946'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:35.688467 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6d6770fb-ae45-4539-aefa-4ae6602f9534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0349bf08ee440c9819aa2e75738946'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:35.700391 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1402/2788] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:47:35 2022] DELETE /identity/v3/users/0a0349bf08ee440c9819aa2e75738946 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:36.124088 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:36.125896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:36.139713 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4dc33-8b0b-4a4e-9d21-86ef67b43f78 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:36.206733 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:36.207382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:36.207664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:36.207934 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] PATH_INFO: `/v3/projects/40fbc9ff787c4508a0771ce2d56a5fdc` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:36.209082 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fbc9ff787c4508a0771ce2d56a5fdc)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:36.211014 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:36.222641 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:36.339033 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fbc9ff787c4508a0771ce2d56a5fdc', 'request_id': 'req-cd49d6fb-9442-48b5-a455-2d836be4997b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:36.345579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fbc9ff787c4508a0771ce2d56a5fdc', 'request_id': 'req-cd49d6fb-9442-48b5-a455-2d836be4997b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:36.351031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fbc9ff787c4508a0771ce2d56a5fdc', 'request_id': 'req-cd49d6fb-9442-48b5-a455-2d836be4997b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:36.445921 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] The token cache is being invalidate because project 40fbc9ff787c4508a0771ce2d56a5fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:47:36.446210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:36.446830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cd49d6fb-9442-48b5-a455-2d836be4997b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:36.448332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1387/2789] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:47:36 2022] DELETE /identity/v3/projects/40fbc9ff787c4508a0771ce2d56a5fdc => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:47:36.454093 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caab9c-0a89-48a3-9c6f-db9985e74f3b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:36.454603 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caab9c-0a89-48a3-9c6f-db9985e74f3b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:36.454705 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caab9c-0a89-48a3-9c6f-db9985e74f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:36.474679 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-85caab9c-0a89-48a3-9c6f-db9985e74f3b None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:36.475807 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-85caab9c-0a89-48a3-9c6f-db9985e74f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:36.516475 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:36.535541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1403/2790] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:36.600478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247eab44-e7fd-4577-88b9-7cc0a477790d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:36.600761 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247eab44-e7fd-4577-88b9-7cc0a477790d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:36.601032 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247eab44-e7fd-4577-88b9-7cc0a477790d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:36.621614 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-247eab44-e7fd-4577-88b9-7cc0a477790d None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:36.622812 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-247eab44-e7fd-4577-88b9-7cc0a477790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:36.630876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1388/2791] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:36.634989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caab9c-0a89-48a3-9c6f-db9985e74f3b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:36.645344 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caab9c-0a89-48a3-9c6f-db9985e74f3b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:36.649860 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf40b31-52fe-488b-a9fa-50b0234366ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:36.650470 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf40b31-52fe-488b-a9fa-50b0234366ff admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:36.650752 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf40b31-52fe-488b-a9fa-50b0234366ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:36.651091 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf40b31-52fe-488b-a9fa-50b0234366ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:36.651845 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf40b31-52fe-488b-a9fa-50b0234366ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:47:36.652152 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf40b31-52fe-488b-a9fa-50b0234366ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:36.653898 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf40b31-52fe-488b-a9fa-50b0234366ff admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:36.669176 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1404/2792] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:47:36.671808 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247eab44-e7fd-4577-88b9-7cc0a477790d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:36.681263 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247eab44-e7fd-4577-88b9-7cc0a477790d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:36.686051 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715355c-0097-40b8-b615-8d6dd23c413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:36.687173 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715355c-0097-40b8-b615-8d6dd23c413b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:36.687448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715355c-0097-40b8-b615-8d6dd23c413b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:36.687805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715355c-0097-40b8-b615-8d6dd23c413b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:36.688585 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715355c-0097-40b8-b615-8d6dd23c413b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:36.690727 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715355c-0097-40b8-b615-8d6dd23c413b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:36.801856 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1389/2793] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:47:36 2022] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:36.807005 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf40b31-52fe-488b-a9fa-50b0234366ff admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:36.819199 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf40b31-52fe-488b-a9fa-50b0234366ff admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:36.877117 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecb49a-d9c9-4a70-8cbe-b646e961a5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:36.877796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb49a-d9c9-4a70-8cbe-b646e961a5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:36.878074 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb49a-d9c9-4a70-8cbe-b646e961a5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:36.878345 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb49a-d9c9-4a70-8cbe-b646e961a5d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:36.879059 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecb49a-d9c9-4a70-8cbe-b646e961a5d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:36.880974 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecb49a-d9c9-4a70-8cbe-b646e961a5d8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:37.000167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1405/2794] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:47:36 2022] POST /identity/v3/users => generated 278 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:37.004352 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715355c-0097-40b8-b615-8d6dd23c413b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:37.015967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715355c-0097-40b8-b615-8d6dd23c413b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:37.021020 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dca2af-0428-47ef-85b0-87dd4e63baae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:37.021666 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca2af-0428-47ef-85b0-87dd4e63baae admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:37.021943 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca2af-0428-47ef-85b0-87dd4e63baae admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:37.022212 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca2af-0428-47ef-85b0-87dd4e63baae admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:37.022967 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dca2af-0428-47ef-85b0-87dd4e63baae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:37.024561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dca2af-0428-47ef-85b0-87dd4e63baae admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:37.035863 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1390/2795] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:37.040520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecb49a-d9c9-4a70-8cbe-b646e961a5d8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:37.052048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecb49a-d9c9-4a70-8cbe-b646e961a5d8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:37.056743 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc947932-af91-48d7-9693-2734f7a884e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:37.057373 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc947932-af91-48d7-9693-2734f7a884e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:37.057651 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc947932-af91-48d7-9693-2734f7a884e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:37.057919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc947932-af91-48d7-9693-2734f7a884e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:37.058607 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc947932-af91-48d7-9693-2734f7a884e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:37.060192 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc947932-af91-48d7-9693-2734f7a884e6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:37.071382 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1406/2796] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:37.075710 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dca2af-0428-47ef-85b0-87dd4e63baae admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:37.086332 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dca2af-0428-47ef-85b0-87dd4e63baae admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:37.091130 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1031af-b93c-4af6-8fe4-d62c0c6c94d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:37.091787 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1031af-b93c-4af6-8fe4-d62c0c6c94d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:37.092047 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1031af-b93c-4af6-8fe4-d62c0c6c94d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:37.092840 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1031af-b93c-4af6-8fe4-d62c0c6c94d9 admin admin] PATH_INFO: `/v3/projects/01958be3dc9f4413afa192851d67191d/users/e7257950891a4d8393f0a90c5f498cc1/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:37.110446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1031af-b93c-4af6-8fe4-d62c0c6c94d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01958be3dc9f4413afa192851d67191d, user_id=e7257950891a4d8393f0a90c5f498cc1, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:37.113085 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1031af-b93c-4af6-8fe4-d62c0c6c94d9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:37.224151 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1391/2797] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:37 2022] PUT /identity/v3/projects/01958be3dc9f4413afa192851d67191d/users/e7257950891a4d8393f0a90c5f498cc1/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:47:37.228891 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00566cd3-d638-460a-9854-305fd1888e9a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:37.230518 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00566cd3-d638-460a-9854-305fd1888e9a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:37.230874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00566cd3-d638-460a-9854-305fd1888e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:37.260619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-00566cd3-d638-460a-9854-305fd1888e9a None None] MFA Rules not processed for user `e7257950891a4d8393f0a90c5f498cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:37.261867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-00566cd3-d638-460a-9854-305fd1888e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:37.318881 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1031af-b93c-4af6-8fe4-d62c0c6c94d9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:37.321040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0e1031af-b93c-4af6-8fe4-d62c0c6c94d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:37.354806 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1407/2798] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:37 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:47:37.356448 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00566cd3-d638-460a-9854-305fd1888e9a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:37.410758 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:37.411191 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1031af-b93c-4af6-8fe4-d62c0c6c94d9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:37.416338 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:37.416993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:37.417306 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:37.417577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] PATH_INFO: `/v3/users/de8777f9a8c74f8b8912d79352a764da` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:37.418905 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8777f9a8c74f8b8912d79352a764da)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:37.421588 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:37.432786 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00566cd3-d638-460a-9854-305fd1888e9a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:37.438488 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fe921-b027-4bbf-a464-9e06933d308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:37.439178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fe921-b027-4bbf-a464-9e06933d308a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:37.439576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fe921-b027-4bbf-a464-9e06933d308a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:37.439852 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fe921-b027-4bbf-a464-9e06933d308a admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:37.440513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fe921-b027-4bbf-a464-9e06933d308a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:37.442440 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fe921-b027-4bbf-a464-9e06933d308a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:37.539410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1408/2799] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:47:37 2022] POST /identity/v3/projects => generated 355 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:47:37.543228 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fe921-b027-4bbf-a464-9e06933d308a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:37.586542 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:37.591979 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8777f9a8c74f8b8912d79352a764da'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:37.606010 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fe921-b027-4bbf-a464-9e06933d308a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:37.611538 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332055fb-7828-4e7f-9fbd-2d44ad138c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:37.612150 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332055fb-7828-4e7f-9fbd-2d44ad138c0e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:37.612441 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332055fb-7828-4e7f-9fbd-2d44ad138c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:37.612718 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332055fb-7828-4e7f-9fbd-2d44ad138c0e admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:37.613418 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332055fb-7828-4e7f-9fbd-2d44ad138c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:37.615332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332055fb-7828-4e7f-9fbd-2d44ad138c0e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:37.640882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8777f9a8c74f8b8912d79352a764da'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:37.641531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8777f9a8c74f8b8912d79352a764da'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:37.642155 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8777f9a8c74f8b8912d79352a764da'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:37.654660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8777f9a8c74f8b8912d79352a764da'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:37.667852 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1392/2800] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:47:37 2022] DELETE /identity/v3/users/de8777f9a8c74f8b8912d79352a764da => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:37.700715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1409/2801] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:47:37 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:47:37.702734 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:37.705513 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:37.775940 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8f78d-48c4-4f08-b1de-dc7528cfd7bc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:37.781408 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6100017-92d8-4204-84f5-21c4ae857776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:37.782030 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100017-92d8-4204-84f5-21c4ae857776 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:37.782303 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100017-92d8-4204-84f5-21c4ae857776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:37.782589 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100017-92d8-4204-84f5-21c4ae857776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:37.783414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6100017-92d8-4204-84f5-21c4ae857776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:37.785009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6100017-92d8-4204-84f5-21c4ae857776 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:37.799488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1393/2802] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:47:37.800618 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332055fb-7828-4e7f-9fbd-2d44ad138c0e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:37.810704 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332055fb-7828-4e7f-9fbd-2d44ad138c0e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:37.815539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91741d47-934d-4294-adae-6dd365a2e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:37.816214 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91741d47-934d-4294-adae-6dd365a2e66e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:37.816496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91741d47-934d-4294-adae-6dd365a2e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:37.816774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91741d47-934d-4294-adae-6dd365a2e66e admin admin] PATH_INFO: `/v3/projects/57203a947d7c4a5da93d71dc0f45ade9/users/17e4c34b53bc4fca94c4585d7f8db9ac/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:37.833035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91741d47-934d-4294-adae-6dd365a2e66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57203a947d7c4a5da93d71dc0f45ade9, user_id=17e4c34b53bc4fca94c4585d7f8db9ac, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:37.835759 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91741d47-934d-4294-adae-6dd365a2e66e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:37.930504 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1410/2803] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:37 2022] PUT /identity/v3/projects/57203a947d7c4a5da93d71dc0f45ade9/users/17e4c34b53bc4fca94c4585d7f8db9ac/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:47:37.934557 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6100017-92d8-4204-84f5-21c4ae857776 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:37.944913 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6100017-92d8-4204-84f5-21c4ae857776 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:37.960548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91741d47-934d-4294-adae-6dd365a2e66e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:37.962880 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-91741d47-934d-4294-adae-6dd365a2e66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:38.017451 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b14d0d-d59c-4c72-b4f2-d8435264cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:38.018325 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14d0d-d59c-4c72-b4f2-d8435264cd24 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.018620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14d0d-d59c-4c72-b4f2-d8435264cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.018883 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b14d0d-d59c-4c72-b4f2-d8435264cd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.019579 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b14d0d-d59c-4c72-b4f2-d8435264cd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:38.021242 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b14d0d-d59c-4c72-b4f2-d8435264cd24 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:38.032136 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1394/2804] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:38.036440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b14d0d-d59c-4c72-b4f2-d8435264cd24 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:38.039683 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91741d47-934d-4294-adae-6dd365a2e66e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:38.044737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:38.046492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.046492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.046492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] PATH_INFO: `/v3/projects/17b69a7e4bbc443c922e699fdfd925b8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.047226 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b14d0d-d59c-4c72-b4f2-d8435264cd24 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:38.048052 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b69a7e4bbc443c922e699fdfd925b8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:38.050055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:38.052023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c1126-5db4-4e1c-b2ef-335625fcc839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:38.052684 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c1126-5db4-4e1c-b2ef-335625fcc839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.052993 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c1126-5db4-4e1c-b2ef-335625fcc839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.053305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c1126-5db4-4e1c-b2ef-335625fcc839 admin admin] PATH_INFO: `/v3/projects/57203a947d7c4a5da93d71dc0f45ade9/users/17e4c34b53bc4fca94c4585d7f8db9ac/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.055283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c1126-5db4-4e1c-b2ef-335625fcc839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57203a947d7c4a5da93d71dc0f45ade9, user_id=17e4c34b53bc4fca94c4585d7f8db9ac, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:38.057968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c1126-5db4-4e1c-b2ef-335625fcc839 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:38.070533 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1395/2805] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:38 2022] PUT /identity/v3/projects/57203a947d7c4a5da93d71dc0f45ade9/users/17e4c34b53bc4fca94c4585d7f8db9ac/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:38.081838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe7acb-f366-4521-be9c-e48f6972c2b8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.082120 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe7acb-f366-4521-be9c-e48f6972c2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.082390 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe7acb-f366-4521-be9c-e48f6972c2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.116366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7dfe7acb-f366-4521-be9c-e48f6972c2b8 None None] MFA Rules not processed for user `17e4c34b53bc4fca94c4585d7f8db9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:38.117620 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7dfe7acb-f366-4521-be9c-e48f6972c2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:38.141947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:38.159774 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:38.173775 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b69a7e4bbc443c922e699fdfd925b8', 'request_id': 'req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:38.180514 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b69a7e4bbc443c922e699fdfd925b8', 'request_id': 'req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:38.186839 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b69a7e4bbc443c922e699fdfd925b8', 'request_id': 'req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:38.190472 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1396/2806] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:38 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:47:38.201784 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe7acb-f366-4521-be9c-e48f6972c2b8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:38.203184 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7dfe7acb-f366-4521-be9c-e48f6972c2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:38.259869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe7acb-f366-4521-be9c-e48f6972c2b8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:38.274445 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] The token cache is being invalidate because project 17b69a7e4bbc443c922e699fdfd925b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:47:38.274802 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:38.275545 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf5d6f32-f537-4a7e-9267-3f09a3ec4b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:38.277398 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1411/2807] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:47:37 2022] DELETE /identity/v3/projects/17b69a7e4bbc443c922e699fdfd925b8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:47:38.282676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852793fb-dbfd-48e9-a574-513a89637549 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.282961 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852793fb-dbfd-48e9-a574-513a89637549 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.283287 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852793fb-dbfd-48e9-a574-513a89637549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.303372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-852793fb-dbfd-48e9-a574-513a89637549 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:38.304510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-852793fb-dbfd-48e9-a574-513a89637549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:38.309004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52702353-e29a-4ace-91e2-0a05c0b20358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:38.309648 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52702353-e29a-4ace-91e2-0a05c0b20358 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.309950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52702353-e29a-4ace-91e2-0a05c0b20358 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.310225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52702353-e29a-4ace-91e2-0a05c0b20358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.312874 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-52702353-e29a-4ace-91e2-0a05c0b20358 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:38.365667 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1412/2808] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:47:38.373171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b77c-7caa-405f-8fee-8690b480c348 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.373462 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b77c-7caa-405f-8fee-8690b480c348 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.374362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b77c-7caa-405f-8fee-8690b480c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.379844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52702353-e29a-4ace-91e2-0a05c0b20358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:38.381350 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52702353-e29a-4ace-91e2-0a05c0b20358 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:38.391401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1397/2809] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:47:38 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:47:38.394255 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5050b77c-7caa-405f-8fee-8690b480c348 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:38.395459 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5050b77c-7caa-405f-8fee-8690b480c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:38.403427 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1413/2810] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:47:38.407691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52702353-e29a-4ace-91e2-0a05c0b20358 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:38.423446 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52702353-e29a-4ace-91e2-0a05c0b20358 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:38.423656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251a778-1c22-48b2-bca1-308221e51164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:38.424275 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251a778-1c22-48b2-bca1-308221e51164 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.424555 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251a778-1c22-48b2-bca1-308221e51164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.424823 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251a778-1c22-48b2-bca1-308221e51164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.425549 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251a778-1c22-48b2-bca1-308221e51164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:47:38.425851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251a778-1c22-48b2-bca1-308221e51164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:38.427437 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251a778-1c22-48b2-bca1-308221e51164 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:38.439327 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1398/2811] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:47:38.443730 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050b77c-7caa-405f-8fee-8690b480c348 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:38.453480 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050b77c-7caa-405f-8fee-8690b480c348 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:38.458197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148c3c-733b-4beb-8e57-93f2f96cf55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:38.458813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148c3c-733b-4beb-8e57-93f2f96cf55c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.459094 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148c3c-733b-4beb-8e57-93f2f96cf55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.459365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148c3c-733b-4beb-8e57-93f2f96cf55c admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.460040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b148c3c-733b-4beb-8e57-93f2f96cf55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:38.461978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b148c3c-733b-4beb-8e57-93f2f96cf55c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:38.575931 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1414/2812] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:47:38 2022] POST /identity/v3/projects => generated 399 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:38.577232 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251a778-1c22-48b2-bca1-308221e51164 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:38.587561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251a778-1c22-48b2-bca1-308221e51164 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:38.596942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:38.641492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148c3c-733b-4beb-8e57-93f2f96cf55c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:38.643234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3b148c3c-733b-4beb-8e57-93f2f96cf55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:38.645040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb597827-81ab-4ba8-a3e6-915fb5a8fd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:38.645711 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb597827-81ab-4ba8-a3e6-915fb5a8fd3d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.645995 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb597827-81ab-4ba8-a3e6-915fb5a8fd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.646269 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb597827-81ab-4ba8-a3e6-915fb5a8fd3d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.646969 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb597827-81ab-4ba8-a3e6-915fb5a8fd3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:38.648919 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb597827-81ab-4ba8-a3e6-915fb5a8fd3d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:38.700873 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148c3c-733b-4beb-8e57-93f2f96cf55c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:38.704970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5833-c5fe-4dda-b1db-ee5c571845d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:38.705639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5833-c5fe-4dda-b1db-ee5c571845d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.705971 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5833-c5fe-4dda-b1db-ee5c571845d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.706265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5833-c5fe-4dda-b1db-ee5c571845d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.708054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-710d5833-c5fe-4dda-b1db-ee5c571845d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:38.725283 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1399/2813] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:47:38 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:47:38.729328 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb597827-81ab-4ba8-a3e6-915fb5a8fd3d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:38.740233 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb597827-81ab-4ba8-a3e6-915fb5a8fd3d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:38.745162 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b1fe-5846-4a50-a27c-6b2dd120c71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:38.745753 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b1fe-5846-4a50-a27c-6b2dd120c71f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.746079 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b1fe-5846-4a50-a27c-6b2dd120c71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.746353 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b1fe-5846-4a50-a27c-6b2dd120c71f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.747197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4b1fe-5846-4a50-a27c-6b2dd120c71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:38.749261 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4b1fe-5846-4a50-a27c-6b2dd120c71f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:38.758343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:38.761485 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1400/2814] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 05:47:38.765842 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b1fe-5846-4a50-a27c-6b2dd120c71f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:38.775805 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d5833-c5fe-4dda-b1db-ee5c571845d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:38.776862 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b1fe-5846-4a50-a27c-6b2dd120c71f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:38.777323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d5833-c5fe-4dda-b1db-ee5c571845d7 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:38.782250 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a47f5a-2b2f-4fb5-8caf-077cef071402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:38.782855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a47f5a-2b2f-4fb5-8caf-077cef071402 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.783131 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a47f5a-2b2f-4fb5-8caf-077cef071402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.783397 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a47f5a-2b2f-4fb5-8caf-077cef071402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.784104 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a47f5a-2b2f-4fb5-8caf-077cef071402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:38.785740 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a47f5a-2b2f-4fb5-8caf-077cef071402 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:38.787356 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1415/2815] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:47:38 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:47:38.798161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1401/2816] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:38.801086 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5833-c5fe-4dda-b1db-ee5c571845d7 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:38.812092 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5833-c5fe-4dda-b1db-ee5c571845d7 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:38.816794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb416d-2f58-4c46-b2fb-3097e107b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:38.817498 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb416d-2f58-4c46-b2fb-3097e107b0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.817905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb416d-2f58-4c46-b2fb-3097e107b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.818181 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb416d-2f58-4c46-b2fb-3097e107b0e6 admin admin] PATH_INFO: `/v3/projects/fd96b301b77d4da3a96bb2de89b607c8/users/0ad15c83465d4894b9622639878f9b78/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.834450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb416d-2f58-4c46-b2fb-3097e107b0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd96b301b77d4da3a96bb2de89b607c8, user_id=0ad15c83465d4894b9622639878f9b78, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:38.837050 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb416d-2f58-4c46-b2fb-3097e107b0e6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:38.944619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1416/2817] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:38 2022] PUT /identity/v3/projects/fd96b301b77d4da3a96bb2de89b607c8/users/0ad15c83465d4894b9622639878f9b78/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:47:38.956502 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfdae2-e89b-4ad9-b451-0b344b933c6c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:38.956789 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfdae2-e89b-4ad9-b451-0b344b933c6c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:38.957063 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfdae2-e89b-4ad9-b451-0b344b933c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:38.985006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5ecfdae2-e89b-4ad9-b451-0b344b933c6c None None] MFA Rules not processed for user `0ad15c83465d4894b9622639878f9b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:38.986260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5ecfdae2-e89b-4ad9-b451-0b344b933c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:39.052500 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1402/2818] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:39.064932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb416d-2f58-4c46-b2fb-3097e107b0e6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:39.066853 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9bfb416d-2f58-4c46-b2fb-3097e107b0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:39.124760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb416d-2f58-4c46-b2fb-3097e107b0e6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:39.128610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d4490-7c02-4b46-ad0f-1648b3828044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:39.129265 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d4490-7c02-4b46-ad0f-1648b3828044 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:39.129697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d4490-7c02-4b46-ad0f-1648b3828044 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:39.129974 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d4490-7c02-4b46-ad0f-1648b3828044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:39.142359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d4490-7c02-4b46-ad0f-1648b3828044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:39.142359 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d4490-7c02-4b46-ad0f-1648b3828044 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:39.151411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1417/2819] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:47:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:47:44.987119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfdae2-e89b-4ad9-b451-0b344b933c6c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:45.049736 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfdae2-e89b-4ad9-b451-0b344b933c6c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:45.054228 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:45.054854 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:45.055133 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:45.055403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] PATH_INFO: `/v3/users/0ad15c83465d4894b9622639878f9b78` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:45.056560 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad15c83465d4894b9622639878f9b78)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:45.058506 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:45.070509 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:45.243086 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad15c83465d4894b9622639878f9b78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:45.318507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad15c83465d4894b9622639878f9b78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:45.319126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad15c83465d4894b9622639878f9b78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:45.319755 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad15c83465d4894b9622639878f9b78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:45.332774 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad15c83465d4894b9622639878f9b78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:45.345157 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1403/2820] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:47:44 2022] DELETE /identity/v3/users/0ad15c83465d4894b9622639878f9b78 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:45.350938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d9a4-e96d-495d-b560-037084240302 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:45.350938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d9a4-e96d-495d-b560-037084240302 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:45.350938 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d9a4-e96d-495d-b560-037084240302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:45.369329 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3927d9a4-e96d-495d-b560-037084240302 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:45.370464 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3927d9a4-e96d-495d-b560-037084240302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:45.430493 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1418/2821] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:45.441058 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:45.442530 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:45.499272 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff0947-c46a-4e63-9f6e-d7703a124d21 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:45.503134 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed852422-4fdf-4a5c-b385-defecabdbfcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:45.503795 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852422-4fdf-4a5c-b385-defecabdbfcf service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:45.504082 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852422-4fdf-4a5c-b385-defecabdbfcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:45.504351 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852422-4fdf-4a5c-b385-defecabdbfcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:45.513333 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed852422-4fdf-4a5c-b385-defecabdbfcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:45.517259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed852422-4fdf-4a5c-b385-defecabdbfcf service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:45.524112 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1404/2822] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:47:45.887875 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927d9a4-e96d-495d-b560-037084240302 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:45.889403 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3927d9a4-e96d-495d-b560-037084240302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:45.901950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927d9a4-e96d-495d-b560-037084240302 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:45.907719 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:45.908395 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:45.908678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:45.908953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] PATH_INFO: `/v3/projects/fd96b301b77d4da3a96bb2de89b607c8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:45.910154 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd96b301b77d4da3a96bb2de89b607c8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:45.912077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:46.093674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd96b301b77d4da3a96bb2de89b607c8', 'request_id': 'req-515f196a-a85c-4610-a113-6500371d14ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:46.099930 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd96b301b77d4da3a96bb2de89b607c8', 'request_id': 'req-515f196a-a85c-4610-a113-6500371d14ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:46.104560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:46.105737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd96b301b77d4da3a96bb2de89b607c8', 'request_id': 'req-515f196a-a85c-4610-a113-6500371d14ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:46.206411 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] The token cache is being invalidate because project fd96b301b77d4da3a96bb2de89b607c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:47:46.210320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:46.210320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-515f196a-a85c-4610-a113-6500371d14ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:46.210320 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1419/2823] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:47:45 2022] DELETE /identity/v3/projects/fd96b301b77d4da3a96bb2de89b607c8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:55.520025 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=48,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:56.325959 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=3,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:56.449720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed852422-4fdf-4a5c-b385-defecabdbfcf service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:56.451239 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ed852422-4fdf-4a5c-b385-defecabdbfcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:56.464249 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed852422-4fdf-4a5c-b385-defecabdbfcf service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:56.520374 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:56.521066 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:56.521376 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:56.521646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] PATH_INFO: `/v3/users/e7257950891a4d8393f0a90c5f498cc1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:56.522870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7257950891a4d8393f0a90c5f498cc1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:56.524810 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:56.743381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7257950891a4d8393f0a90c5f498cc1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:56.815180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7257950891a4d8393f0a90c5f498cc1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:56.815794 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7257950891a4d8393f0a90c5f498cc1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:56.816399 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7257950891a4d8393f0a90c5f498cc1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:56.828278 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7257950891a4d8393f0a90c5f498cc1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:56.840050 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1405/2824] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:47:56 2022] DELETE /identity/v3/users/e7257950891a4d8393f0a90c5f498cc1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:56.845318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee39d-37e1-47d0-b879-51f90cf5ffbf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:56.845639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee39d-37e1-47d0-b879-51f90cf5ffbf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:56.845916 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ee39d-37e1-47d0-b879-51f90cf5ffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:56.866071 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4d8ee39d-37e1-47d0-b879-51f90cf5ffbf None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:56.867260 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4d8ee39d-37e1-47d0-b879-51f90cf5ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:56.926120 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1420/2825] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:47:56.935660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:56.937603 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:56.994750 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f8759-747c-470a-889d-c7e58cb39b08 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:56.998234 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89330118-bdfb-49f0-8ce7-b75c1526ef8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:56.998834 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89330118-bdfb-49f0-8ce7-b75c1526ef8c service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:56.999110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89330118-bdfb-49f0-8ce7-b75c1526ef8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:56.999407 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89330118-bdfb-49f0-8ce7-b75c1526ef8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:57.008255 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89330118-bdfb-49f0-8ce7-b75c1526ef8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:57.009791 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89330118-bdfb-49f0-8ce7-b75c1526ef8c service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:57.019664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1406/2826] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:47:57.397333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ee39d-37e1-47d0-b879-51f90cf5ffbf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:57.401045 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4d8ee39d-37e1-47d0-b879-51f90cf5ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:57.411643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ee39d-37e1-47d0-b879-51f90cf5ffbf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:57.416753 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:57.417447 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:57.417733 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:57.418008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] PATH_INFO: `/v3/projects/01958be3dc9f4413afa192851d67191d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:57.419168 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01958be3dc9f4413afa192851d67191d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:57.421789 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:57.527970 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01958be3dc9f4413afa192851d67191d', 'request_id': 'req-2160ad85-39fa-469f-8d3a-b73e2ba13b30'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:57.534410 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01958be3dc9f4413afa192851d67191d', 'request_id': 'req-2160ad85-39fa-469f-8d3a-b73e2ba13b30'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:57.540446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01958be3dc9f4413afa192851d67191d', 'request_id': 'req-2160ad85-39fa-469f-8d3a-b73e2ba13b30'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:57.622674 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] The token cache is being invalidate because project 01958be3dc9f4413afa192851d67191d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:47:57.622960 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:57.623571 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:57.626056 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1421/2827] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:47:57 2022] DELETE /identity/v3/projects/01958be3dc9f4413afa192851d67191d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:57.630363 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89330118-bdfb-49f0-8ce7-b75c1526ef8c service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:57.639830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89330118-bdfb-49f0-8ce7-b75c1526ef8c service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:57.657622 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:57.695965 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba40eaa-6637-435d-86a7-8a378c271be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:57.696598 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba40eaa-6637-435d-86a7-8a378c271be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:57.696878 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba40eaa-6637-435d-86a7-8a378c271be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:57.697172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba40eaa-6637-435d-86a7-8a378c271be8 admin admin] PATH_INFO: `/v3/users/17e4c34b53bc4fca94c4585d7f8db9ac` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:57.698317 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba40eaa-6637-435d-86a7-8a378c271be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e4c34b53bc4fca94c4585d7f8db9ac)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:57.700266 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba40eaa-6637-435d-86a7-8a378c271be8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:57.893449 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1ba40eaa-6637-435d-86a7-8a378c271be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e4c34b53bc4fca94c4585d7f8db9ac'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:57.992364 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1ba40eaa-6637-435d-86a7-8a378c271be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e4c34b53bc4fca94c4585d7f8db9ac'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:57.992990 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1ba40eaa-6637-435d-86a7-8a378c271be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e4c34b53bc4fca94c4585d7f8db9ac'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:57.993658 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1ba40eaa-6637-435d-86a7-8a378c271be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e4c34b53bc4fca94c4585d7f8db9ac'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:58.006433 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1ba40eaa-6637-435d-86a7-8a378c271be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e4c34b53bc4fca94c4585d7f8db9ac'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:58.018956 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1407/2828] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:47:57 2022] DELETE /identity/v3/users/17e4c34b53bc4fca94c4585d7f8db9ac => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:58.430830 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:58.432297 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:58.447677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160ad85-39fa-469f-8d3a-b73e2ba13b30 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:58.506409 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:58.507054 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:58.507333 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:58.507604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] PATH_INFO: `/v3/projects/57203a947d7c4a5da93d71dc0f45ade9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:58.508748 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] RBAC: Authorizing `identity:delete_project(project_id=57203a947d7c4a5da93d71dc0f45ade9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:58.510687 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:58.590560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:58.606598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57203a947d7c4a5da93d71dc0f45ade9', 'request_id': 'req-a7712e06-bc09-4d8d-8920-c8432f25420b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:58.612835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57203a947d7c4a5da93d71dc0f45ade9', 'request_id': 'req-a7712e06-bc09-4d8d-8920-c8432f25420b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:58.618296 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57203a947d7c4a5da93d71dc0f45ade9', 'request_id': 'req-a7712e06-bc09-4d8d-8920-c8432f25420b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:58.697444 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] The token cache is being invalidate because project 57203a947d7c4a5da93d71dc0f45ade9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:47:58.697640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:58.698246 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a7712e06-bc09-4d8d-8920-c8432f25420b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:47:58.699786 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1422/2829] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:47:58 2022] DELETE /identity/v3/projects/57203a947d7c4a5da93d71dc0f45ade9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:58.705654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f97635-2a3f-4d0d-8dc5-66dc03b66e49 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:58.706142 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f97635-2a3f-4d0d-8dc5-66dc03b66e49 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:58.706259 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f97635-2a3f-4d0d-8dc5-66dc03b66e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:58.726382 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f6f97635-2a3f-4d0d-8dc5-66dc03b66e49 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:58.736839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f6f97635-2a3f-4d0d-8dc5-66dc03b66e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:58.787547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1408/2830] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:58.795469 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024eaff-0f09-4f41-a1aa-5add046c3d96 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:58.795760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024eaff-0f09-4f41-a1aa-5add046c3d96 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:58.796039 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024eaff-0f09-4f41-a1aa-5add046c3d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:58.816676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7024eaff-0f09-4f41-a1aa-5add046c3d96 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:58.817904 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7024eaff-0f09-4f41-a1aa-5add046c3d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:58.825753 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1423/2831] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:58.830574 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f97635-2a3f-4d0d-8dc5-66dc03b66e49 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:58.840011 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f97635-2a3f-4d0d-8dc5-66dc03b66e49 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:58.845034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7569b8-19f6-4f7b-8979-6ce24c3cb735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:58.845664 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7569b8-19f6-4f7b-8979-6ce24c3cb735 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:58.845938 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7569b8-19f6-4f7b-8979-6ce24c3cb735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:58.846203 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7569b8-19f6-4f7b-8979-6ce24c3cb735 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:58.846891 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7569b8-19f6-4f7b-8979-6ce24c3cb735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:47:58.847187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7569b8-19f6-4f7b-8979-6ce24c3cb735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:58.848798 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7569b8-19f6-4f7b-8979-6ce24c3cb735 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:58.859926 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1409/2832] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:47:58.864119 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024eaff-0f09-4f41-a1aa-5add046c3d96 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:58.873045 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024eaff-0f09-4f41-a1aa-5add046c3d96 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:58.878372 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10864525-0b15-4cfd-a958-5df1319f5bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:58.878966 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10864525-0b15-4cfd-a958-5df1319f5bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:58.879241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10864525-0b15-4cfd-a958-5df1319f5bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:58.879513 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10864525-0b15-4cfd-a958-5df1319f5bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:58.880170 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10864525-0b15-4cfd-a958-5df1319f5bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:58.882077 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10864525-0b15-4cfd-a958-5df1319f5bd8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:58.990848 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1424/2833] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:47:58 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 05:47:58.995052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7569b8-19f6-4f7b-8979-6ce24c3cb735 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:59.005542 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7569b8-19f6-4f7b-8979-6ce24c3cb735 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:59.031667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:59.062813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf140f0-8082-44d1-a050-7871544b26f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:59.063763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf140f0-8082-44d1-a050-7871544b26f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:59.064094 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf140f0-8082-44d1-a050-7871544b26f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:59.064531 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf140f0-8082-44d1-a050-7871544b26f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:59.065654 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf140f0-8082-44d1-a050-7871544b26f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:59.067575 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf140f0-8082-44d1-a050-7871544b26f9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:59.162236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1410/2834] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:47:58 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:59.166919 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10864525-0b15-4cfd-a958-5df1319f5bd8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:59.178142 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10864525-0b15-4cfd-a958-5df1319f5bd8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:59.182813 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6770b95-227f-4ff4-a523-839e5520b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:59.183422 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6770b95-227f-4ff4-a523-839e5520b725 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:59.183699 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6770b95-227f-4ff4-a523-839e5520b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:59.183972 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6770b95-227f-4ff4-a523-839e5520b725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:59.184656 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6770b95-227f-4ff4-a523-839e5520b725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:59.186269 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6770b95-227f-4ff4-a523-839e5520b725 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:59.196749 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1425/2835] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:59.200741 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf140f0-8082-44d1-a050-7871544b26f9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:59.210716 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf140f0-8082-44d1-a050-7871544b26f9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:59.215365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ece0c-5ba5-49ff-806c-6d48f5225c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:59.215971 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ece0c-5ba5-49ff-806c-6d48f5225c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:59.216251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ece0c-5ba5-49ff-806c-6d48f5225c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:59.216521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ece0c-5ba5-49ff-806c-6d48f5225c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:59.217247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ece0c-5ba5-49ff-806c-6d48f5225c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:59.219043 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ece0c-5ba5-49ff-806c-6d48f5225c60 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:59.229126 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1411/2836] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:59.233240 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6770b95-227f-4ff4-a523-839e5520b725 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:59.244450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6770b95-227f-4ff4-a523-839e5520b725 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:59.249038 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d629574-6353-4e82-94ba-b0f4952e7c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:59.250863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d629574-6353-4e82-94ba-b0f4952e7c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:59.251137 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d629574-6353-4e82-94ba-b0f4952e7c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:59.251406 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d629574-6353-4e82-94ba-b0f4952e7c77 admin admin] PATH_INFO: `/v3/projects/5f17574bfe9d4220bbfab6d58da76416/users/08f4cdcc109843eb9e2c4a63d9273105/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:59.266251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d629574-6353-4e82-94ba-b0f4952e7c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f17574bfe9d4220bbfab6d58da76416, user_id=08f4cdcc109843eb9e2c4a63d9273105, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:59.268874 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d629574-6353-4e82-94ba-b0f4952e7c77 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:59.337414 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1426/2837] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:59 2022] PUT /identity/v3/projects/5f17574bfe9d4220bbfab6d58da76416/users/08f4cdcc109843eb9e2c4a63d9273105/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:47:59.347766 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57678ee7-d544-4a70-b157-b509465eca8c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:59.348052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57678ee7-d544-4a70-b157-b509465eca8c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:59.348326 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57678ee7-d544-4a70-b157-b509465eca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:59.377707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-57678ee7-d544-4a70-b157-b509465eca8c None None] MFA Rules not processed for user `08f4cdcc109843eb9e2c4a63d9273105`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:59.378896 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-57678ee7-d544-4a70-b157-b509465eca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:59.443040 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1412/2838] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:47:59.447678 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d629574-6353-4e82-94ba-b0f4952e7c77 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:59.510780 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d629574-6353-4e82-94ba-b0f4952e7c77 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:59.515417 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac6682-1740-4aa1-87dd-af4d0e2d24cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:59.516024 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6682-1740-4aa1-87dd-af4d0e2d24cb admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:59.516308 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6682-1740-4aa1-87dd-af4d0e2d24cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:59.516589 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6682-1740-4aa1-87dd-af4d0e2d24cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:59.517275 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac6682-1740-4aa1-87dd-af4d0e2d24cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:59.519204 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac6682-1740-4aa1-87dd-af4d0e2d24cb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:59.584306 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1427/2839] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:47:59 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:59.588496 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57678ee7-d544-4a70-b157-b509465eca8c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:59.599679 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57678ee7-d544-4a70-b157-b509465eca8c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:59.654691 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8582f8-1992-4cc7-8ebc-cd61bb959070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:59.655305 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8582f8-1992-4cc7-8ebc-cd61bb959070 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:59.656092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8582f8-1992-4cc7-8ebc-cd61bb959070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:59.656375 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8582f8-1992-4cc7-8ebc-cd61bb959070 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:59.657031 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8582f8-1992-4cc7-8ebc-cd61bb959070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:59.658977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8582f8-1992-4cc7-8ebc-cd61bb959070 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:59.731448 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1413/2840] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:47:59 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:47:59.736480 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac6682-1740-4aa1-87dd-af4d0e2d24cb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:59.746729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac6682-1740-4aa1-87dd-af4d0e2d24cb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:59.751670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb18d1-918d-422c-aa90-9c0946ced2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:59.752273 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb18d1-918d-422c-aa90-9c0946ced2aa admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:59.752553 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb18d1-918d-422c-aa90-9c0946ced2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:59.752829 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb18d1-918d-422c-aa90-9c0946ced2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:59.753633 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb18d1-918d-422c-aa90-9c0946ced2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:59.755244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb18d1-918d-422c-aa90-9c0946ced2aa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:59.765915 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1428/2841] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:59.769801 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8582f8-1992-4cc7-8ebc-cd61bb959070 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:59.779707 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8582f8-1992-4cc7-8ebc-cd61bb959070 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:59.785309 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2414514-71a7-4da9-b61b-cfd71a4ae742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:59.785904 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2414514-71a7-4da9-b61b-cfd71a4ae742 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:59.786180 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2414514-71a7-4da9-b61b-cfd71a4ae742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:59.786475 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2414514-71a7-4da9-b61b-cfd71a4ae742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:59.787160 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2414514-71a7-4da9-b61b-cfd71a4ae742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:59.789006 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2414514-71a7-4da9-b61b-cfd71a4ae742 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:59.800034 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1414/2842] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:47:59.804023 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb18d1-918d-422c-aa90-9c0946ced2aa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:47:59.814008 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb18d1-918d-422c-aa90-9c0946ced2aa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:47:59.818658 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb56ce-7a81-4cc4-89cf-2b69815ade55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:47:59.819298 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb56ce-7a81-4cc4-89cf-2b69815ade55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:59.819576 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb56ce-7a81-4cc4-89cf-2b69815ade55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:59.819847 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb56ce-7a81-4cc4-89cf-2b69815ade55 admin admin] PATH_INFO: `/v3/projects/dc7945dca18847d3b303e3d26141d966/users/49cd9eb3c49a4a0caefef9c20a61c6f1/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:59.831506 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:47:59.834641 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb56ce-7a81-4cc4-89cf-2b69815ade55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7945dca18847d3b303e3d26141d966, user_id=49cd9eb3c49a4a0caefef9c20a61c6f1, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:47:59.837365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb56ce-7a81-4cc4-89cf-2b69815ade55 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:47:59.931905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1429/2843] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:47:59 2022] PUT /identity/v3/projects/dc7945dca18847d3b303e3d26141d966/users/49cd9eb3c49a4a0caefef9c20a61c6f1/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:47:59.943576 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fa3d9-8a9e-404b-9f90-7952aac35842 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:47:59.943858 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fa3d9-8a9e-404b-9f90-7952aac35842 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:47:59.944176 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fa3d9-8a9e-404b-9f90-7952aac35842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:47:59.973154 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8f5fa3d9-8a9e-404b-9f90-7952aac35842 None None] MFA Rules not processed for user `49cd9eb3c49a4a0caefef9c20a61c6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:47:59.974477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8f5fa3d9-8a9e-404b-9f90-7952aac35842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:47:59.978554 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:00.037936 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1415/2844] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:47:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:48:00.042762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb56ce-7a81-4cc4-89cf-2b69815ade55 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:00.104055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb56ce-7a81-4cc4-89cf-2b69815ade55 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:00.108670 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c5e76-2131-4b38-bbbf-8db092588bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:00.109318 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c5e76-2131-4b38-bbbf-8db092588bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:00.109598 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c5e76-2131-4b38-bbbf-8db092588bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:00.109866 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c5e76-2131-4b38-bbbf-8db092588bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:00.110528 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c5e76-2131-4b38-bbbf-8db092588bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:00.112405 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c5e76-2131-4b38-bbbf-8db092588bd5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:00.194560 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1430/2845] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:48:00 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:48:00.198631 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fa3d9-8a9e-404b-9f90-7952aac35842 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:00.209678 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fa3d9-8a9e-404b-9f90-7952aac35842 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:00.268225 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e15ea-30c2-4a55-9c88-3cceace3dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:00.268838 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e15ea-30c2-4a55-9c88-3cceace3dd41 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:00.269123 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e15ea-30c2-4a55-9c88-3cceace3dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:00.269427 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e15ea-30c2-4a55-9c88-3cceace3dd41 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:00.270089 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e15ea-30c2-4a55-9c88-3cceace3dd41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:00.272009 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e15ea-30c2-4a55-9c88-3cceace3dd41 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:00.376770 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1416/2846] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:48:00 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:48:00.380816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c5e76-2131-4b38-bbbf-8db092588bd5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:00.392523 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c5e76-2131-4b38-bbbf-8db092588bd5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:00.397744 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad512b1a-0b0a-4504-b68a-8b6559f0f00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:00.397744 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512b1a-0b0a-4504-b68a-8b6559f0f00b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:00.398171 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512b1a-0b0a-4504-b68a-8b6559f0f00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:00.398449 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512b1a-0b0a-4504-b68a-8b6559f0f00b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:00.399130 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad512b1a-0b0a-4504-b68a-8b6559f0f00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:00.400715 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad512b1a-0b0a-4504-b68a-8b6559f0f00b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:00.412178 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1431/2847] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:48:00.416739 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e15ea-30c2-4a55-9c88-3cceace3dd41 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:00.426974 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e15ea-30c2-4a55-9c88-3cceace3dd41 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:00.431646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5e48b-a522-4ccb-8119-6ef69f870cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:00.432297 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5e48b-a522-4ccb-8119-6ef69f870cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:00.432578 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5e48b-a522-4ccb-8119-6ef69f870cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:00.432851 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5e48b-a522-4ccb-8119-6ef69f870cf6 admin admin] PATH_INFO: `/v3/projects/37253fcf78954949848195ba79e42f1c/users/b3006875dd864b76a3e4e38fb45ab8e1/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:00.448018 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5e48b-a522-4ccb-8119-6ef69f870cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37253fcf78954949848195ba79e42f1c, user_id=b3006875dd864b76a3e4e38fb45ab8e1, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:00.450730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5e48b-a522-4ccb-8119-6ef69f870cf6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:00.526339 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1417/2848] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:48:00 2022] PUT /identity/v3/projects/37253fcf78954949848195ba79e42f1c/users/b3006875dd864b76a3e4e38fb45ab8e1/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:00.530362 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad512b1a-0b0a-4504-b68a-8b6559f0f00b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:00.541100 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad512b1a-0b0a-4504-b68a-8b6559f0f00b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:00.596574 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aa536-1a9c-4b6a-a274-ea2930df042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:00.597244 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aa536-1a9c-4b6a-a274-ea2930df042c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:00.597527 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aa536-1a9c-4b6a-a274-ea2930df042c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:00.597800 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aa536-1a9c-4b6a-a274-ea2930df042c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:00.598524 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aa536-1a9c-4b6a-a274-ea2930df042c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:00.600155 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aa536-1a9c-4b6a-a274-ea2930df042c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:00.610477 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1432/2849] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:48:00.614667 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5e48b-a522-4ccb-8119-6ef69f870cf6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:00.625440 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5e48b-a522-4ccb-8119-6ef69f870cf6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:00.630324 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808d1bf-efb2-4387-b43c-84ef9b3cefcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:00.630935 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808d1bf-efb2-4387-b43c-84ef9b3cefcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:00.631218 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808d1bf-efb2-4387-b43c-84ef9b3cefcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:00.631490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808d1bf-efb2-4387-b43c-84ef9b3cefcb admin admin] PATH_INFO: `/v3/projects/37253fcf78954949848195ba79e42f1c/users/b3006875dd864b76a3e4e38fb45ab8e1/roles/57a86ff4c9de433399662eebf6893065` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:00.633477 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808d1bf-efb2-4387-b43c-84ef9b3cefcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=37253fcf78954949848195ba79e42f1c, user_id=b3006875dd864b76a3e4e38fb45ab8e1, role_id=57a86ff4c9de433399662eebf6893065)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:00.636145 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808d1bf-efb2-4387-b43c-84ef9b3cefcb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:00.648628 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1418/2850] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:48:00 2022] PUT /identity/v3/projects/37253fcf78954949848195ba79e42f1c/users/b3006875dd864b76a3e4e38fb45ab8e1/roles/57a86ff4c9de433399662eebf6893065 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:00.660615 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a212-3f5b-48b9-a9e1-c782b12e1a6f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:00.660835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a212-3f5b-48b9-a9e1-c782b12e1a6f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:00.661108 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a212-3f5b-48b9-a9e1-c782b12e1a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:00.691567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1ce0a212-3f5b-48b9-a9e1-c782b12e1a6f None None] MFA Rules not processed for user `b3006875dd864b76a3e4e38fb45ab8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:48:00.692783 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1ce0a212-3f5b-48b9-a9e1-c782b12e1a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:00.761958 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:00.791167 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1433/2851] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:48:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:48:00.802874 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808d1bf-efb2-4387-b43c-84ef9b3cefcb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:00.804991 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1808d1bf-efb2-4387-b43c-84ef9b3cefcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:00.870248 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808d1bf-efb2-4387-b43c-84ef9b3cefcb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:00.874111 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94120e-dab4-40e9-830b-2d4cc9ade370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:00.874746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94120e-dab4-40e9-830b-2d4cc9ade370 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:00.875251 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94120e-dab4-40e9-830b-2d4cc9ade370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:00.875521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94120e-dab4-40e9-830b-2d4cc9ade370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:00.885401 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94120e-dab4-40e9-830b-2d4cc9ade370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:00.886796 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94120e-dab4-40e9-830b-2d4cc9ade370 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:00.893118 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:00.898197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1419/2852] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:48:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:48:02.020785 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0a212-3f5b-48b9-a9e1-c782b12e1a6f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:02.022233 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1ce0a212-3f5b-48b9-a9e1-c782b12e1a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:02.034691 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0a212-3f5b-48b9-a9e1-c782b12e1a6f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:02.038487 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a99d58-92ba-4410-86af-5a327a441fb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:02.039088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a99d58-92ba-4410-86af-5a327a441fb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:02.039365 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a99d58-92ba-4410-86af-5a327a441fb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:02.039634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a99d58-92ba-4410-86af-5a327a441fb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:02.095068 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a99d58-92ba-4410-86af-5a327a441fb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:02.096419 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a99d58-92ba-4410-86af-5a327a441fb6 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:02.106031 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1434/2853] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:48:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:48:07.003817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94120e-dab4-40e9-830b-2d4cc9ade370 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:07.012521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94120e-dab4-40e9-830b-2d4cc9ade370 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:07.016394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be68f52-d754-4445-a27d-b23b6062f188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:07.021383 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be68f52-d754-4445-a27d-b23b6062f188 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:07.021383 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be68f52-d754-4445-a27d-b23b6062f188 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:07.021383 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be68f52-d754-4445-a27d-b23b6062f188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:07.074479 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be68f52-d754-4445-a27d-b23b6062f188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:07.075951 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be68f52-d754-4445-a27d-b23b6062f188 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:07.085643 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1420/2854] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:48:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:48:10.719737 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a99d58-92ba-4410-86af-5a327a441fb6 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:10.721312 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-61a99d58-92ba-4410-86af-5a327a441fb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:10.785663 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a99d58-92ba-4410-86af-5a327a441fb6 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:10.791634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a906f-673b-49bd-80af-dd72453db096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:10.791634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a906f-673b-49bd-80af-dd72453db096 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:10.791634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a906f-673b-49bd-80af-dd72453db096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:10.791634 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a906f-673b-49bd-80af-dd72453db096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:10.793367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-101a906f-673b-49bd-80af-dd72453db096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:10.829662 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be68f52-d754-4445-a27d-b23b6062f188 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:10.876083 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a906f-673b-49bd-80af-dd72453db096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:10.877570 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a906f-673b-49bd-80af-dd72453db096 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:10.889573 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1435/2855] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:48:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:48:10.894697 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be68f52-d754-4445-a27d-b23b6062f188 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:10.899271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:10.899924 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:10.900209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:10.900499 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] PATH_INFO: `/v3/users/08f4cdcc109843eb9e2c4a63d9273105` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:10.901720 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08f4cdcc109843eb9e2c4a63d9273105)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:10.903827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:11.104161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f4cdcc109843eb9e2c4a63d9273105'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:11.166550 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f4cdcc109843eb9e2c4a63d9273105'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:11.167104 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f4cdcc109843eb9e2c4a63d9273105'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:11.167779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f4cdcc109843eb9e2c4a63d9273105'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:11.181108 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f4cdcc109843eb9e2c4a63d9273105'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:11.193827 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1421/2856] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:48:10 2022] DELETE /identity/v3/users/08f4cdcc109843eb9e2c4a63d9273105 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:48:11.198274 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24adcaf-4641-4dc8-8c91-48d51195aba5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:11.198557 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24adcaf-4641-4dc8-8c91-48d51195aba5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:11.198854 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24adcaf-4641-4dc8-8c91-48d51195aba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:11.218695 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d24adcaf-4641-4dc8-8c91-48d51195aba5 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:48:11.219903 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d24adcaf-4641-4dc8-8c91-48d51195aba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:11.240825 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:11.280980 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1436/2857] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:48:11.290731 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:11.292137 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:11.312197 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:11.354790 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834995d6-95a7-4149-a3bd-038355af34c7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:11.358558 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82603e2d-8e00-4fbe-99cd-342951204b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:11.359488 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603e2d-8e00-4fbe-99cd-342951204b42 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:11.359746 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603e2d-8e00-4fbe-99cd-342951204b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:11.360013 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603e2d-8e00-4fbe-99cd-342951204b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:11.371669 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82603e2d-8e00-4fbe-99cd-342951204b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:11.373525 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82603e2d-8e00-4fbe-99cd-342951204b42 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:11.402096 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1422/2858] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:48:11.985146 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24adcaf-4641-4dc8-8c91-48d51195aba5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:11.986610 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d24adcaf-4641-4dc8-8c91-48d51195aba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:11.999835 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24adcaf-4641-4dc8-8c91-48d51195aba5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:12.009797 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:12.010458 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:12.010738 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:12.011012 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] PATH_INFO: `/v3/projects/5f17574bfe9d4220bbfab6d58da76416` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:12.025673 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f17574bfe9d4220bbfab6d58da76416)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:12.027677 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:12.136717 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f17574bfe9d4220bbfab6d58da76416', 'request_id': 'req-23243eb2-5314-4f63-afad-7caa1765ca3c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:12.146288 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f17574bfe9d4220bbfab6d58da76416', 'request_id': 'req-23243eb2-5314-4f63-afad-7caa1765ca3c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:12.152768 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f17574bfe9d4220bbfab6d58da76416', 'request_id': 'req-23243eb2-5314-4f63-afad-7caa1765ca3c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:12.251698 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] The token cache is being invalidate because project 5f17574bfe9d4220bbfab6d58da76416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:48:12.251918 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:12.252515 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:12.255118 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1437/2859] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:48:11 2022] DELETE /identity/v3/projects/5f17574bfe9d4220bbfab6d58da76416 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:12.259116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82603e2d-8e00-4fbe-99cd-342951204b42 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:12.269590 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82603e2d-8e00-4fbe-99cd-342951204b42 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:12.330110 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:12.330750 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:12.331027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:12.331972 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] PATH_INFO: `/v3/users/49cd9eb3c49a4a0caefef9c20a61c6f1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:12.333466 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49cd9eb3c49a4a0caefef9c20a61c6f1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:12.335413 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:12.519618 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49cd9eb3c49a4a0caefef9c20a61c6f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:12.598929 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49cd9eb3c49a4a0caefef9c20a61c6f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:12.599703 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49cd9eb3c49a4a0caefef9c20a61c6f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:12.600345 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49cd9eb3c49a4a0caefef9c20a61c6f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:12.613852 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49cd9eb3c49a4a0caefef9c20a61c6f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:12.626124 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1423/2860] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:48:12 2022] DELETE /identity/v3/users/49cd9eb3c49a4a0caefef9c20a61c6f1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:13.057910 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:13.059384 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:13.087412 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23243eb2-5314-4f63-afad-7caa1765ca3c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:13.173461 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:13.174831 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:13.176156 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:13.176863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] PATH_INFO: `/v3/projects/dc7945dca18847d3b303e3d26141d966` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:13.179387 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7945dca18847d3b303e3d26141d966)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:13.181565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:13.326783 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7945dca18847d3b303e3d26141d966', 'request_id': 'req-fe7b7a37-672d-4362-a5f6-c12bb9335f67'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:13.330326 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:13.336293 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7945dca18847d3b303e3d26141d966', 'request_id': 'req-fe7b7a37-672d-4362-a5f6-c12bb9335f67'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:13.349413 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7945dca18847d3b303e3d26141d966', 'request_id': 'req-fe7b7a37-672d-4362-a5f6-c12bb9335f67'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:13.552593 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] The token cache is being invalidate because project dc7945dca18847d3b303e3d26141d966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:48:13.552849 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:13.553446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:13.555484 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1438/2861] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:48:13 2022] DELETE /identity/v3/projects/dc7945dca18847d3b303e3d26141d966 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:13.559186 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:13.560743 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:13.573660 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49251d4e-4ee0-462c-982c-104b96499f61 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:13.619372 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:13.645779 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:13.646917 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:13.647365 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:13.647820 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] PATH_INFO: `/v3/users/b3006875dd864b76a3e4e38fb45ab8e1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:13.649314 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3006875dd864b76a3e4e38fb45ab8e1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:13.651751 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:13.899356 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3006875dd864b76a3e4e38fb45ab8e1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:14.028945 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3006875dd864b76a3e4e38fb45ab8e1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:14.030027 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3006875dd864b76a3e4e38fb45ab8e1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:14.030640 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3006875dd864b76a3e4e38fb45ab8e1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:14.045453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3006875dd864b76a3e4e38fb45ab8e1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:14.058373 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1424/2862] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:48:13 2022] DELETE /identity/v3/users/b3006875dd864b76a3e4e38fb45ab8e1 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:14.452219 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:14.453676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:14.502927 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:14.504656 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:14.513492 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b7a37-672d-4362-a5f6-c12bb9335f67 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:14.565680 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f431b7-f318-46cd-b0df-e17638ab2c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:14.566450 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f431b7-f318-46cd-b0df-e17638ab2c4a service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:14.566799 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f431b7-f318-46cd-b0df-e17638ab2c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:14.567144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f431b7-f318-46cd-b0df-e17638ab2c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:14.569026 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45f431b7-f318-46cd-b0df-e17638ab2c4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:14.588003 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40467df-c470-4635-9098-8c861ce2a7bd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:14.590663 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:14.591300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:14.591580 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:14.591845 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] PATH_INFO: `/v3/projects/37253fcf78954949848195ba79e42f1c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:14.592985 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37253fcf78954949848195ba79e42f1c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:14.594934 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:14.640740 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f431b7-f318-46cd-b0df-e17638ab2c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:14.642197 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f431b7-f318-46cd-b0df-e17638ab2c4a service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:14.653000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1439/2863] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:48:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:48:14.699416 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37253fcf78954949848195ba79e42f1c', 'request_id': 'req-d67ca150-0b9a-40bc-89c4-b891eb45d663'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:14.708296 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37253fcf78954949848195ba79e42f1c', 'request_id': 'req-d67ca150-0b9a-40bc-89c4-b891eb45d663'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:14.712988 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:14.714179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37253fcf78954949848195ba79e42f1c', 'request_id': 'req-d67ca150-0b9a-40bc-89c4-b891eb45d663'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:14.805737 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] The token cache is being invalidate because project 37253fcf78954949848195ba79e42f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:48:14.806095 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:14.806657 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d67ca150-0b9a-40bc-89c4-b891eb45d663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:14.808178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1425/2864] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:48:14 2022] DELETE /identity/v3/projects/37253fcf78954949848195ba79e42f1c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:14.814206 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e945a5-5d47-4d23-915b-0ed22c1a2a3e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:14.814491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e945a5-5d47-4d23-915b-0ed22c1a2a3e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:14.814764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e945a5-5d47-4d23-915b-0ed22c1a2a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:14.834575 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-20e945a5-5d47-4d23-915b-0ed22c1a2a3e None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:48:14.835770 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-20e945a5-5d47-4d23-915b-0ed22c1a2a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:14.868198 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:14.898007 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1440/2865] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:48:14.907974 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d679cd-5c9c-4b07-8a08-d2430fc7e9a5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:14.908403 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d679cd-5c9c-4b07-8a08-d2430fc7e9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:14.908681 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d679cd-5c9c-4b07-8a08-d2430fc7e9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:14.930419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-01d679cd-5c9c-4b07-8a08-d2430fc7e9a5 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:48:14.930839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-01d679cd-5c9c-4b07-8a08-d2430fc7e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:14.939156 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1426/2866] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:48:14.943421 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e945a5-5d47-4d23-915b-0ed22c1a2a3e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:14.953456 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e945a5-5d47-4d23-915b-0ed22c1a2a3e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:14.958627 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5a05f-0e2f-4239-9a4b-da0f15a14164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:14.959241 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5a05f-0e2f-4239-9a4b-da0f15a14164 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:14.959520 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5a05f-0e2f-4239-9a4b-da0f15a14164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:14.959794 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5a05f-0e2f-4239-9a4b-da0f15a14164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:14.960489 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5a05f-0e2f-4239-9a4b-da0f15a14164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:48:14.960795 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5a05f-0e2f-4239-9a4b-da0f15a14164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:14.962446 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5a05f-0e2f-4239-9a4b-da0f15a14164 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:14.974764 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1441/2867] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:48:14.979092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d679cd-5c9c-4b07-8a08-d2430fc7e9a5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:14.988311 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d679cd-5c9c-4b07-8a08-d2430fc7e9a5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:14.993019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972cb43-7385-4e00-94e9-a78a731dd28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:14.993839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972cb43-7385-4e00-94e9-a78a731dd28b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:14.994116 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972cb43-7385-4e00-94e9-a78a731dd28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:14.994388 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972cb43-7385-4e00-94e9-a78a731dd28b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:14.995052 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972cb43-7385-4e00-94e9-a78a731dd28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:14.996952 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972cb43-7385-4e00-94e9-a78a731dd28b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:15.100019 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1427/2868] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:48:14 2022] POST /identity/v3/projects => generated 359 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:48:15.104251 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5a05f-0e2f-4239-9a4b-da0f15a14164 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:15.114486 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5a05f-0e2f-4239-9a4b-da0f15a14164 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:15.173425 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185a510-fd34-419a-81df-7e517779274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:15.174048 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a510-fd34-419a-81df-7e517779274d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:15.174343 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a510-fd34-419a-81df-7e517779274d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:15.174604 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185a510-fd34-419a-81df-7e517779274d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:15.175315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185a510-fd34-419a-81df-7e517779274d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:15.177243 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185a510-fd34-419a-81df-7e517779274d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:15.297657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1442/2869] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:48:15 2022] POST /identity/v3/users => generated 280 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:48:15.301974 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972cb43-7385-4e00-94e9-a78a731dd28b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:15.312224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972cb43-7385-4e00-94e9-a78a731dd28b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:15.317978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1ef84-7757-4984-b703-418d4c6ff2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:15.318587 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ef84-7757-4984-b703-418d4c6ff2fb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:15.318869 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ef84-7757-4984-b703-418d4c6ff2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:15.319143 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1ef84-7757-4984-b703-418d4c6ff2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:15.319839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1ef84-7757-4984-b703-418d4c6ff2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:15.321482 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1ef84-7757-4984-b703-418d4c6ff2fb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:15.332264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1428/2870] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:48:15.336004 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185a510-fd34-419a-81df-7e517779274d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:15.345868 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185a510-fd34-419a-81df-7e517779274d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:15.350676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c53f8a-c8b1-411f-8995-43dab092d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:15.351267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c53f8a-c8b1-411f-8995-43dab092d92b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:15.351546 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c53f8a-c8b1-411f-8995-43dab092d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:15.351811 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c53f8a-c8b1-411f-8995-43dab092d92b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:15.352491 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c53f8a-c8b1-411f-8995-43dab092d92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:15.354085 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c53f8a-c8b1-411f-8995-43dab092d92b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:15.364055 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1443/2871] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:48:15.368469 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1ef84-7757-4984-b703-418d4c6ff2fb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:15.379174 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1ef84-7757-4984-b703-418d4c6ff2fb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:15.383814 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be93fe-ed90-48d5-a44b-25d275fc049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:15.384785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be93fe-ed90-48d5-a44b-25d275fc049f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:15.384785 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be93fe-ed90-48d5-a44b-25d275fc049f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:15.385004 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be93fe-ed90-48d5-a44b-25d275fc049f admin admin] PATH_INFO: `/v3/projects/351a9119f14b4368832707608c531895/users/faa40161075d4c5aa50b0f88ae6e7ac6/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:15.401478 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be93fe-ed90-48d5-a44b-25d275fc049f admin admin] RBAC: Authorizing `identity:create_grant(project_id=351a9119f14b4368832707608c531895, user_id=faa40161075d4c5aa50b0f88ae6e7ac6, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:15.404161 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be93fe-ed90-48d5-a44b-25d275fc049f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:15.462244 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1429/2872] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:48:15 2022] PUT /identity/v3/projects/351a9119f14b4368832707608c531895/users/faa40161075d4c5aa50b0f88ae6e7ac6/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:48:15.473657 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2bb3c-035f-4cc6-9da4-bc4fbe1308ee None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:15.474116 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2bb3c-035f-4cc6-9da4-bc4fbe1308ee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:15.474239 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2bb3c-035f-4cc6-9da4-bc4fbe1308ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:15.501953 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-89d2bb3c-035f-4cc6-9da4-bc4fbe1308ee None None] MFA Rules not processed for user `faa40161075d4c5aa50b0f88ae6e7ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:48:15.503770 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-89d2bb3c-035f-4cc6-9da4-bc4fbe1308ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:15.567635 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1444/2873] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:48:15 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:48:15.600219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be93fe-ed90-48d5-a44b-25d275fc049f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:15.601978 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-08be93fe-ed90-48d5-a44b-25d275fc049f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:15.657458 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be93fe-ed90-48d5-a44b-25d275fc049f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:15.661366 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dc28d-1f85-4df9-aaa4-b633a4a725f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:15.661977 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc28d-1f85-4df9-aaa4-b633a4a725f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:15.662254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc28d-1f85-4df9-aaa4-b633a4a725f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:15.662521 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc28d-1f85-4df9-aaa4-b633a4a725f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:15.670873 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846dc28d-1f85-4df9-aaa4-b633a4a725f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:15.672294 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846dc28d-1f85-4df9-aaa4-b633a4a725f0 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:15.681381 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1430/2874] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:48:15 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:48:15.697040 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2bb3c-035f-4cc6-9da4-bc4fbe1308ee None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:15.730126 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:15.758217 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2bb3c-035f-4cc6-9da4-bc4fbe1308ee None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:15.763347 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:15.763979 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:15.764263 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:15.764555 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] PATH_INFO: `/v3/users/faa40161075d4c5aa50b0f88ae6e7ac6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:15.765735 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa40161075d4c5aa50b0f88ae6e7ac6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:15.767643 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:16.027129 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa40161075d4c5aa50b0f88ae6e7ac6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:16.028957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa40161075d4c5aa50b0f88ae6e7ac6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:16.106999 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa40161075d4c5aa50b0f88ae6e7ac6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:16.107690 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa40161075d4c5aa50b0f88ae6e7ac6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:16.123264 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa40161075d4c5aa50b0f88ae6e7ac6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:16.136984 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1445/2875] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:48:15 2022] DELETE /identity/v3/users/faa40161075d4c5aa50b0f88ae6e7ac6 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:16.141507 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56a56-f383-4995-848c-641020a9adc7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:16.141876 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56a56-f383-4995-848c-641020a9adc7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:16.142150 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56a56-f383-4995-848c-641020a9adc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:16.162357 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a4d56a56-f383-4995-848c-641020a9adc7 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:48:16.163850 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a4d56a56-f383-4995-848c-641020a9adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:16.226125 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1431/2876] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:48:16.235548 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:16.236989 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:16.294762 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378996c-fee1-493c-882a-da111fcf55b7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:16.298311 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec874b-7ef3-44d5-9d7a-e831f018698b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:16.298932 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec874b-7ef3-44d5-9d7a-e831f018698b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:16.299203 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec874b-7ef3-44d5-9d7a-e831f018698b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:16.299472 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec874b-7ef3-44d5-9d7a-e831f018698b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:16.309865 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec874b-7ef3-44d5-9d7a-e831f018698b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:16.311290 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec874b-7ef3-44d5-9d7a-e831f018698b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:16.321950 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1446/2877] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:48:16.887870 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d56a56-f383-4995-848c-641020a9adc7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:16.892410 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a4d56a56-f383-4995-848c-641020a9adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:16.901551 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d56a56-f383-4995-848c-641020a9adc7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:16.906149 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:16.906789 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:16.907179 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:16.907346 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] PATH_INFO: `/v3/projects/351a9119f14b4368832707608c531895` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:16.908536 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=351a9119f14b4368832707608c531895)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:16.911256 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:16.936421 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:17.039447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351a9119f14b4368832707608c531895', 'request_id': 'req-a6337103-d95a-4650-b2e9-267282426f97'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:17.045802 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351a9119f14b4368832707608c531895', 'request_id': 'req-a6337103-d95a-4650-b2e9-267282426f97'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:17.051730 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351a9119f14b4368832707608c531895', 'request_id': 'req-a6337103-d95a-4650-b2e9-267282426f97'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:17.134434 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] The token cache is being invalidate because project 351a9119f14b4368832707608c531895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:48:17.134647 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:17.135311 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6337103-d95a-4650-b2e9-267282426f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:17.136811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1432/2878] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:48:16 2022] DELETE /identity/v3/projects/351a9119f14b4368832707608c531895 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:17.148339 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56936baf-41d9-46f6-a6db-47bcbebe82f4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:17.148843 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56936baf-41d9-46f6-a6db-47bcbebe82f4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:17.148955 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56936baf-41d9-46f6-a6db-47bcbebe82f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:17.169455 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-56936baf-41d9-46f6-a6db-47bcbebe82f4 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:48:17.170676 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-56936baf-41d9-46f6-a6db-47bcbebe82f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:17.218385 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:17.230082 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1447/2879] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:48:17.237937 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a9007-cd6a-4aa8-a5c3-043b01e9e3bb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:17.238221 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a9007-cd6a-4aa8-a5c3-043b01e9e3bb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:17.238495 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a9007-cd6a-4aa8-a5c3-043b01e9e3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:17.258202 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-363a9007-cd6a-4aa8-a5c3-043b01e9e3bb None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:48:17.259414 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-363a9007-cd6a-4aa8-a5c3-043b01e9e3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:17.267316 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1433/2880] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:48:17.272144 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56936baf-41d9-46f6-a6db-47bcbebe82f4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:17.282684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56936baf-41d9-46f6-a6db-47bcbebe82f4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:17.288428 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d480e14-0786-4295-a4d8-9ec393945980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:17.289033 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d480e14-0786-4295-a4d8-9ec393945980 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:17.289350 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d480e14-0786-4295-a4d8-9ec393945980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:17.289625 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d480e14-0786-4295-a4d8-9ec393945980 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:17.290338 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d480e14-0786-4295-a4d8-9ec393945980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 05:48:17.290646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d480e14-0786-4295-a4d8-9ec393945980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:17.292245 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d480e14-0786-4295-a4d8-9ec393945980 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:17.304261 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1448/2881] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Jul 28 05:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 05:48:17.308544 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a9007-cd6a-4aa8-a5c3-043b01e9e3bb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:17.317655 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a9007-cd6a-4aa8-a5c3-043b01e9e3bb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:17.322215 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd9cb8-2bc7-4de8-b5e8-fde801fc3305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:17.322813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd9cb8-2bc7-4de8-b5e8-fde801fc3305 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:17.323092 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd9cb8-2bc7-4de8-b5e8-fde801fc3305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:17.323361 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd9cb8-2bc7-4de8-b5e8-fde801fc3305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:17.324029 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd9cb8-2bc7-4de8-b5e8-fde801fc3305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:17.325947 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd9cb8-2bc7-4de8-b5e8-fde801fc3305 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:17.393688 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1434/2882] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Jul 28 05:48:17 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:48:17.398328 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d480e14-0786-4295-a4d8-9ec393945980 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:17.408639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d480e14-0786-4295-a4d8-9ec393945980 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:17.464796 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73746c63-8c94-4cd2-add9-255212de4156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:17.465437 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746c63-8c94-4cd2-add9-255212de4156 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:17.465724 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746c63-8c94-4cd2-add9-255212de4156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:17.465998 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746c63-8c94-4cd2-add9-255212de4156 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:17.466659 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73746c63-8c94-4cd2-add9-255212de4156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:17.468581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73746c63-8c94-4cd2-add9-255212de4156 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:17.543760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1449/2883] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 05:48:17 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 05:48:17.547877 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd9cb8-2bc7-4de8-b5e8-fde801fc3305 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:17.558260 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd9cb8-2bc7-4de8-b5e8-fde801fc3305 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:17.567100 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60106c76-dd99-47f5-b16b-94ded436dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:17.567719 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60106c76-dd99-47f5-b16b-94ded436dbea admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:17.567998 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60106c76-dd99-47f5-b16b-94ded436dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:17.568271 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60106c76-dd99-47f5-b16b-94ded436dbea admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:17.568968 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60106c76-dd99-47f5-b16b-94ded436dbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:17.570638 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60106c76-dd99-47f5-b16b-94ded436dbea admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:17.581001 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1435/2884] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:48:17.585646 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73746c63-8c94-4cd2-add9-255212de4156 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:17.595631 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73746c63-8c94-4cd2-add9-255212de4156 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:17.600355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f1d42-e3c3-46be-9af2-cc2b86f213b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:17.600957 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1d42-e3c3-46be-9af2-cc2b86f213b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:17.601266 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1d42-e3c3-46be-9af2-cc2b86f213b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:17.601540 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1d42-e3c3-46be-9af2-cc2b86f213b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:17.602227 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f1d42-e3c3-46be-9af2-cc2b86f213b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:17.603833 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f1d42-e3c3-46be-9af2-cc2b86f213b8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:17.614740 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1450/2885] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Jul 28 05:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 05:48:17.618942 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60106c76-dd99-47f5-b16b-94ded436dbea admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:17.629682 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60106c76-dd99-47f5-b16b-94ded436dbea admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:17.634400 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594fc3-fe4f-4f6d-9619-84ea51e42998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:17.635065 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594fc3-fe4f-4f6d-9619-84ea51e42998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:17.635348 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594fc3-fe4f-4f6d-9619-84ea51e42998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:17.635623 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594fc3-fe4f-4f6d-9619-84ea51e42998 admin admin] PATH_INFO: `/v3/projects/6d2a50a725354a41b083c6312b7dbde3/users/5a38821dad9b4cb193623be8e3093175/roles/a21446fa03b24a5ebbaf61a4827146e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:17.651497 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7594fc3-fe4f-4f6d-9619-84ea51e42998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2a50a725354a41b083c6312b7dbde3, user_id=5a38821dad9b4cb193623be8e3093175, role_id=a21446fa03b24a5ebbaf61a4827146e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:17.654254 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7594fc3-fe4f-4f6d-9619-84ea51e42998 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:17.754359 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1436/2886] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Jul 28 05:48:17 2022] PUT /identity/v3/projects/6d2a50a725354a41b083c6312b7dbde3/users/5a38821dad9b4cb193623be8e3093175/roles/a21446fa03b24a5ebbaf61a4827146e7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:48:17.766253 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38debdbe-c975-408a-87a0-03ff2c26bbb3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:17.766539 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38debdbe-c975-408a-87a0-03ff2c26bbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:17.766816 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38debdbe-c975-408a-87a0-03ff2c26bbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:17.799581 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-38debdbe-c975-408a-87a0-03ff2c26bbb3 None None] MFA Rules not processed for user `5a38821dad9b4cb193623be8e3093175`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:48:17.801565 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-38debdbe-c975-408a-87a0-03ff2c26bbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:17.875123 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1451/2887] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:48:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:48:17.888848 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594fc3-fe4f-4f6d-9619-84ea51e42998 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:17.891153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c7594fc3-fe4f-4f6d-9619-84ea51e42998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:17.954447 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594fc3-fe4f-4f6d-9619-84ea51e42998 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:17.958830 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c21218-2e8b-4e98-bc64-6ea27be10027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce47f69d77124bdbbde63374b270b6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:17.959520 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c21218-2e8b-4e98-bc64-6ea27be10027 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:17.960201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c21218-2e8b-4e98-bc64-6ea27be10027 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:17.960201 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c21218-2e8b-4e98-bc64-6ea27be10027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:17.970805 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c21218-2e8b-4e98-bc64-6ea27be10027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:17.971023 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c21218-2e8b-4e98-bc64-6ea27be10027 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:17.980732 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1437/2888] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:48:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:48:21.349771 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0cc64-465e-44a0-a2ce-0a445d2f3e12 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:21.350226 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0cc64-465e-44a0-a2ce-0a445d2f3e12 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:21.350323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0cc64-465e-44a0-a2ce-0a445d2f3e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:21.370808 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bbe0cc64-465e-44a0-a2ce-0a445d2f3e12 None None] MFA Rules not processed for user `c8577537a1a84cffb5d8aebc4f41e8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:48:21.371997 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bbe0cc64-465e-44a0-a2ce-0a445d2f3e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:21.417400 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:21.428172 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1452/2889] 10.222.0.42 () {58 vars in 967 bytes} [Thu Jul 28 05:48:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 05:48:21.471236 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c21218-2e8b-4e98-bc64-6ea27be10027 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:21.473453 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38c21218-2e8b-4e98-bc64-6ea27be10027 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:21.525763 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:21.543632 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c21218-2e8b-4e98-bc64-6ea27be10027 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:21.548561 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397602a2-2a81-4273-a6c7-4b3068d0ce79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef24fa7356ac455b8994e0e6d1959654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:21.549209 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397602a2-2a81-4273-a6c7-4b3068d0ce79 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:21.549486 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397602a2-2a81-4273-a6c7-4b3068d0ce79 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:21.549754 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397602a2-2a81-4273-a6c7-4b3068d0ce79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:21.557646 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397602a2-2a81-4273-a6c7-4b3068d0ce79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:21.559210 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397602a2-2a81-4273-a6c7-4b3068d0ce79 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:21.567109 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1438/2890] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Jul 28 05:48:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 05:48:29.758494 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0cc64-465e-44a0-a2ce-0a445d2f3e12 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:29.823142 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0cc64-465e-44a0-a2ce-0a445d2f3e12 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:29.827015 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397602a2-2a81-4273-a6c7-4b3068d0ce79 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:29.828630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaf241-2824-4af3-a2fb-eac48381db80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:29.828817 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-397602a2-2a81-4273-a6c7-4b3068d0ce79 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:29.829315 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf241-2824-4af3-a2fb-eac48381db80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:29.829594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf241-2824-4af3-a2fb-eac48381db80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:29.829863 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf241-2824-4af3-a2fb-eac48381db80 admin admin] PATH_INFO: `/v3/users/5a38821dad9b4cb193623be8e3093175` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:29.831051 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaf241-2824-4af3-a2fb-eac48381db80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a38821dad9b4cb193623be8e3093175)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:29.834267 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaf241-2824-4af3-a2fb-eac48381db80 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:29.850182 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397602a2-2a81-4273-a6c7-4b3068d0ce79 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:29.852164 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:29.853035 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:29.853368 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:29.853652 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] PATH_INFO: `/v3/users/ce1b29e93568472082a94f9ffc2543be` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:29.854860 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1b29e93568472082a94f9ffc2543be)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:29.856855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:30.022995 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0feaf241-2824-4af3-a2fb-eac48381db80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a38821dad9b4cb193623be8e3093175'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.023639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0feaf241-2824-4af3-a2fb-eac48381db80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a38821dad9b4cb193623be8e3093175'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.050291 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1b29e93568472082a94f9ffc2543be'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.086496 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0feaf241-2824-4af3-a2fb-eac48381db80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a38821dad9b4cb193623be8e3093175'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.087237 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0feaf241-2824-4af3-a2fb-eac48381db80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a38821dad9b4cb193623be8e3093175'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.101594 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0feaf241-2824-4af3-a2fb-eac48381db80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a38821dad9b4cb193623be8e3093175'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.114640 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1453/2891] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:48:29 2022] DELETE /identity/v3/users/5a38821dad9b4cb193623be8e3093175 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:30.119579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aedaf-28c7-4fe5-bf75-220fb80c7563 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:30.119579 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aedaf-28c7-4fe5-bf75-220fb80c7563 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:30.119867 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aedaf-28c7-4fe5-bf75-220fb80c7563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:30.138978 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-511aedaf-28c7-4fe5-bf75-220fb80c7563 None None] MFA Rules not processed for user `c8a78ca62f5c4d3896c5e2f1cd4cb186`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 05:48:30.140164 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-511aedaf-28c7-4fe5-bf75-220fb80c7563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:30.149119 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1b29e93568472082a94f9ffc2543be'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.149776 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1b29e93568472082a94f9ffc2543be'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.150379 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1b29e93568472082a94f9ffc2543be'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.164464 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1b29e93568472082a94f9ffc2543be'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.180907 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1439/2892] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:48:29 2022] DELETE /identity/v3/users/ce1b29e93568472082a94f9ffc2543be => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:48:30.205323 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1454/2893] 10.222.0.42 () {58 vars in 958 bytes} [Thu Jul 28 05:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 05:48:30.216855 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:30.218311 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:30.279540 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb40c0-1eab-442e-bd8d-82969f539cce admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:30.283767 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a8b4-02c5-4760-afa8-b32d6ba8c1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76596e04e82b43cb8b68ee2f5e6dd9e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:30.284394 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a8b4-02c5-4760-afa8-b32d6ba8c1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:30.284674 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a8b4-02c5-4760-afa8-b32d6ba8c1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:30.284944 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a8b4-02c5-4760-afa8-b32d6ba8c1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:30.348975 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1a8b4-02c5-4760-afa8-b32d6ba8c1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:30.350483 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1a8b4-02c5-4760-afa8-b32d6ba8c1a5 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:30.359953 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1440/2894] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 05:48:30.430394 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511aedaf-28c7-4fe5-bf75-220fb80c7563 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:30.431884 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-511aedaf-28c7-4fe5-bf75-220fb80c7563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:30.449577 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511aedaf-28c7-4fe5-bf75-220fb80c7563 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:30.454375 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:30.455035 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:30.455697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:30.455697 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] PATH_INFO: `/v3/projects/6e915a25c14e4aeca31264d0a12342a4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:30.456760 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e915a25c14e4aeca31264d0a12342a4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:30.459729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:30.471623 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:30.577044 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e915a25c14e4aeca31264d0a12342a4', 'request_id': 'req-1601ba39-7340-4aa5-ad17-0c9a5e91518c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.583543 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e915a25c14e4aeca31264d0a12342a4', 'request_id': 'req-1601ba39-7340-4aa5-ad17-0c9a5e91518c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.589465 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e915a25c14e4aeca31264d0a12342a4', 'request_id': 'req-1601ba39-7340-4aa5-ad17-0c9a5e91518c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.667013 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] The token cache is being invalidate because project 6e915a25c14e4aeca31264d0a12342a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:48:30.667303 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.670367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:30.670367 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1455/2895] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:48:30 2022] DELETE /identity/v3/projects/6e915a25c14e4aeca31264d0a12342a4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:30.673419 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a8b4-02c5-4760-afa8-b32d6ba8c1a5 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:30.679577 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:30.684906 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a8b4-02c5-4760-afa8-b32d6ba8c1a5 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:30.742300 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:30.742939 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:30.743219 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:30.743490 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] PATH_INFO: `/v3/users/e94332a7f6c24fad85ec1ddd0482f30c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:30.744650 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94332a7f6c24fad85ec1ddd0482f30c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:30.746636 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:30.845541 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:30.847101 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:30.860729 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ba39-7340-4aa5-ad17-0c9a5e91518c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:30.866423 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:30.867088 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:30.867355 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:30.867630 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] PATH_INFO: `/v3/projects/6d2a50a725354a41b083c6312b7dbde3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:30.868817 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d2a50a725354a41b083c6312b7dbde3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:30.870776 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:30.926604 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94332a7f6c24fad85ec1ddd0482f30c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.005242 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d2a50a725354a41b083c6312b7dbde3', 'request_id': 'req-e875944a-17d0-4a53-ad4d-ad754c6ecebd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.011875 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d2a50a725354a41b083c6312b7dbde3', 'request_id': 'req-e875944a-17d0-4a53-ad4d-ad754c6ecebd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.015516 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94332a7f6c24fad85ec1ddd0482f30c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.016178 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94332a7f6c24fad85ec1ddd0482f30c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.016811 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94332a7f6c24fad85ec1ddd0482f30c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.017619 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d2a50a725354a41b083c6312b7dbde3', 'request_id': 'req-e875944a-17d0-4a53-ad4d-ad754c6ecebd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.029941 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94332a7f6c24fad85ec1ddd0482f30c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.042844 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1441/2896] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Jul 28 05:48:30 2022] DELETE /identity/v3/users/e94332a7f6c24fad85ec1ddd0482f30c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:31.102639 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] The token cache is being invalidate because project 6d2a50a725354a41b083c6312b7dbde3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:48:31.102934 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.103591 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.106000 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1456/2897] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:48:30 2022] DELETE /identity/v3/projects/6d2a50a725354a41b083c6312b7dbde3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 05:48:31.378839 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:48:31.380153 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:48:31.446042 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2b95a-28ea-4e91-8147-3c7b77d11e62 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:48:31.450547 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8a78ca62f5c4d3896c5e2f1cd4cb186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75ff8d8e50894a1db12ad71f3510dfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:48:31.451172 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:48:31.451450 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:48:31.451722 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] PATH_INFO: `/v3/projects/d95d50b7e1bb4b0e945056195af754eb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:48:31.452882 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95d50b7e1bb4b0e945056195af754eb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:48:31.454813 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:48:31.480264 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:31.582893 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95d50b7e1bb4b0e945056195af754eb', 'request_id': 'req-51220b78-bc21-4262-8085-e340d044fcaf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.588875 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95d50b7e1bb4b0e945056195af754eb', 'request_id': 'req-51220b78-bc21-4262-8085-e340d044fcaf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.594224 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95d50b7e1bb4b0e945056195af754eb', 'request_id': 'req-51220b78-bc21-4262-8085-e340d044fcaf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.684950 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] The token cache is being invalidate because project d95d50b7e1bb4b0e945056195af754eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 05:48:31.685187 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.685822 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-51220b78-bc21-4262-8085-e340d044fcaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 05:48:31.687319 dv-cinder-799871-48-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1442/2898] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Jul 28 05:48:31 2022] DELETE /identity/v3/projects/d95d50b7e1bb4b0e945056195af754eb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 05:48:41.098905 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=47,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:48:41.747247 dv-cinder-799871-48-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:52:21.108131 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 05:52:21.109567 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:52:21.178684 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875944a-17d0-4a53-ad4d-ad754c6ecebd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 05:52:21.237332 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bb61c-0955-454c-8310-d31402b64a8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5593bc41bce41b4b44616c355976cc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a74afe28b3b44b5eb0db99056b652ce6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 05:52:21.237952 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bb61c-0955-454c-8310-d31402b64a8b service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 05:52:21.238234 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bb61c-0955-454c-8310-d31402b64a8b service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 05:52:21.238510 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bb61c-0955-454c-8310-d31402b64a8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 05:52:21.240285 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-817bb61c-0955-454c-8310-d31402b64a8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 05:52:21.251481 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bb61c-0955-454c-8310-d31402b64a8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 05:52:21.253046 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bb61c-0955-454c-8310-d31402b64a8b service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 05:52:21.263564 dv-cinder-799871-48-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1457/2899] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 05:52:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 05:52:31.259360 dv-cinder-799871-48-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=58 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}